Trending...
- NuGuard Launches AI Trust Platform to Close the Behavior Gap and Accelerate Secure Deployments - 110
- California: Governor Newsom secures 13 automakers to offer instant rebates for first-time ZEV buyers - 103
- Allstream Energy Partners Returns as a Media Partner for the 2026 API Inspection & Mechanical Integrity Summit in San Antonio
Plain-English guidance on how much GPU memory and system RAM each model size needs, when self-hosting beats cloud APIs, and how to keep AI data entirely in-house.
FREMONT, Calif. - Californer -- eRacks Open Source Systems today published "Private AI, Sized & Priced," a vendor-neutral buyer's guide for organizations that want to run large language models on their own hardware rather than through a cloud API, and announced that a 70-billion-parameter model now runs on-premise on its AILSA server starting at $5,995.
The guide answers the question eRacks hears most from AI buyers: how big a machine do I actually need? AI servers are priced largely by GPU memory (VRAM). The guide gives a model-size-to-VRAM table (a 70B model in 4-bit quantization needs roughly 42 GB, about 80 GB in 8-bit), and adds the part most buyers miss: system RAM should be 1.5 to 2 times the VRAM, and a multi-GPU server needs a server-class CPU for the PCIe lanes.
It also lays out the cost crossover where owning beats renting. A 30-person team paying $30 per user per month for a cloud AI service spends about $10,800 a year, every year, with all prompts transiting a third party's servers. An on-premise server covers the same everyday inference and pays for itself in under a year. For teams handling protected health information, attorney-client material, government data, or unpublished research, the calculus is simpler still: the data cannot leave their control, and a private server is the only option.
More on The Californer
eRacks AI servers run entirely on open-source software, with Ubuntu Linux plus Ollama, Open WebUI, vLLM, and PyTorch pre-installed and tested, so staff reach the AI from a browser on day one, with no per-seat fees and no data leaving the building.
The guide is published at https://eracks.com/guides/private-ai-sizing/. eRacks has built custom open-source servers since 1999 and will size a private AI server to a customer's exact models and user count at no charge.
About eRacks Open Source Systems
eRacks Open Source Systems is an open-source server and storage specialist founded in 1999, headquartered in Fremont, CA, building rackmount servers, NAS, and AI inference servers configured to customer requirements.
Media Contact
Joseph Wolff eRacks Open Source Systems joe@eracks.com https://eracks.com
The guide answers the question eRacks hears most from AI buyers: how big a machine do I actually need? AI servers are priced largely by GPU memory (VRAM). The guide gives a model-size-to-VRAM table (a 70B model in 4-bit quantization needs roughly 42 GB, about 80 GB in 8-bit), and adds the part most buyers miss: system RAM should be 1.5 to 2 times the VRAM, and a multi-GPU server needs a server-class CPU for the PCIe lanes.
It also lays out the cost crossover where owning beats renting. A 30-person team paying $30 per user per month for a cloud AI service spends about $10,800 a year, every year, with all prompts transiting a third party's servers. An on-premise server covers the same everyday inference and pays for itself in under a year. For teams handling protected health information, attorney-client material, government data, or unpublished research, the calculus is simpler still: the data cannot leave their control, and a private server is the only option.
More on The Californer
- Long Beach Health Department to Host Back-to-School Vaccination and Resource Fair
- PODS Local Ramping Up Community Support for Manna Conejo Valley Food Bank Through July 31st
- California: Governor Newsom delivers $109.6 million in voter-approved Prop 1 funding for 278 supportive homes, including housing for veterans
- American Battery Company Celebrates 100th Anniversary With Senate Proclamation
- US Sourcing Mission to Vietnam from Sept. 02 to Sept. 06, 2026
eRacks AI servers run entirely on open-source software, with Ubuntu Linux plus Ollama, Open WebUI, vLLM, and PyTorch pre-installed and tested, so staff reach the AI from a browser on day one, with no per-seat fees and no data leaving the building.
The guide is published at https://eracks.com/guides/private-ai-sizing/. eRacks has built custom open-source servers since 1999 and will size a private AI server to a customer's exact models and user count at no charge.
About eRacks Open Source Systems
eRacks Open Source Systems is an open-source server and storage specialist founded in 1999, headquartered in Fremont, CA, building rackmount servers, NAS, and AI inference servers configured to customer requirements.
Media Contact
Joseph Wolff eRacks Open Source Systems joe@eracks.com https://eracks.com
Source: eRacks Open Source Systems
Filed Under: Computers
0 Comments
Latest on The Californer
- Meet Privateer: Tucson's High-Tech Security Force Built With Paramilitary Precision
- Noir Vine Society Launches Black Business Month Initiative to Spotlight Black-Owned Wine Brands
- Equoria Systems Launches Enterprise Real Estate Equity Securities & Liquidity Infrastructure
- City of Long Beach Invites Youth to Apply for Youth Advisory Council
- California: Acting Governor Rivas proclaims Disability Pride Month
- Long Beach: Health Department to Distribute Free Firearm Safes to Promote Community Safety and Prevent Firearm-Related Injuries
- City of Long Beach Issues a Heat Alert and Advises Residents to Take Precautions Against Heat
- TEAM Referral Network San Diego Hosts Summer Celebration at The Heights Golf Club
- North Bay Grading and Paving Marks 15 Years, Expands U.S. Coast Guard Asphalt Project
- Sports Byline USA Partners with All In Lid
- Coastal Business Systems Hosts 2026 Tech Show, Welcoming Local Businesses for Office Technology
- California delivers major blow to organized retail theft, recovering $76.2 million in stolen goods since 2019
- Dynamic Dachshund Dog Goes Global: Remember Point Launches a New Bilingual Children's Book
- DARPA Selects NRx Pharmaceuticals Defense Subsidiary for Contract Negotiations on FDA-Authorized SPARC-TMS Clinical Trial Advancing Mental Health Care
- San Diego Rises as a Premier Destination for Many Different Tech Founders and Filmmakers Nationwide
- California: Governor Newsom announces appointments 7.22.2026
- The 18th annual Hola México Film Festival presented by Toyota All-Electric Family
- From the Racetrack to the Boardroom: Aston Martin and Aramco Formula One Partnership Accelerates Circle8 Group: (N A S D A Q: CIRC)
- Connect Expands Regional Reach With Second Office at Kiln Rancho Bernardo
- eRacks Launches AI Provisioning and Setup: Turnkey Private AI Deployment for $1,795, on Its Servers