Trending...
- For International Joke Day: Wanna Tickle that Funny Bone? Check out "Crazy Robert's Joke Book"
- California: Governor Newsom, Legislative leaders announce 2026-27 balanced budget agreement that ensures $0 deficit, while funding healthcare and key services
- Who Is Who International Awards - 2026 Official Event Announcement
Plain-English guidance on how much GPU memory and system RAM each model size needs, when self-hosting beats cloud APIs, and how to keep AI data entirely in-house.
FREMONT, Calif. - Californer -- eRacks Open Source Systems today published "Private AI, Sized & Priced," a vendor-neutral buyer's guide for organizations that want to run large language models on their own hardware rather than through a cloud API, and announced that a 70-billion-parameter model now runs on-premise on its AILSA server starting at $5,995.
The guide answers the question eRacks hears most from AI buyers: how big a machine do I actually need? AI servers are priced largely by GPU memory (VRAM). The guide gives a model-size-to-VRAM table (a 70B model in 4-bit quantization needs roughly 42 GB, about 80 GB in 8-bit), and adds the part most buyers miss: system RAM should be 1.5 to 2 times the VRAM, and a multi-GPU server needs a server-class CPU for the PCIe lanes.
It also lays out the cost crossover where owning beats renting. A 30-person team paying $30 per user per month for a cloud AI service spends about $10,800 a year, every year, with all prompts transiting a third party's servers. An on-premise server covers the same everyday inference and pays for itself in under a year. For teams handling protected health information, attorney-client material, government data, or unpublished research, the calculus is simpler still: the data cannot leave their control, and a private server is the only option.
More on The Californer
eRacks AI servers run entirely on open-source software, with Ubuntu Linux plus Ollama, Open WebUI, vLLM, and PyTorch pre-installed and tested, so staff reach the AI from a browser on day one, with no per-seat fees and no data leaving the building.
The guide is published at https://eracks.com/guides/private-ai-sizing/. eRacks has built custom open-source servers since 1999 and will size a private AI server to a customer's exact models and user count at no charge.
About eRacks Open Source Systems
eRacks Open Source Systems is an open-source server and storage specialist founded in 1999, headquartered in Fremont, CA, building rackmount servers, NAS, and AI inference servers configured to customer requirements.
Media Contact
Joseph Wolff eRacks Open Source Systems joe@eracks.com https://eracks.com
The guide answers the question eRacks hears most from AI buyers: how big a machine do I actually need? AI servers are priced largely by GPU memory (VRAM). The guide gives a model-size-to-VRAM table (a 70B model in 4-bit quantization needs roughly 42 GB, about 80 GB in 8-bit), and adds the part most buyers miss: system RAM should be 1.5 to 2 times the VRAM, and a multi-GPU server needs a server-class CPU for the PCIe lanes.
It also lays out the cost crossover where owning beats renting. A 30-person team paying $30 per user per month for a cloud AI service spends about $10,800 a year, every year, with all prompts transiting a third party's servers. An on-premise server covers the same everyday inference and pays for itself in under a year. For teams handling protected health information, attorney-client material, government data, or unpublished research, the calculus is simpler still: the data cannot leave their control, and a private server is the only option.
More on The Californer
- Atomic Rock Launches $10K 'Enter The Reactor' Tournament to Discover Breakout Independent Acts
- Scapin at North Coast Repertory Theatre
- Tracking Lease Critical Dates Is Getting Automated in 2026
- Insurance Claims Management Is Going AI-First in 2026
- AI Certificate Scanning Is Eliminating Manual Data Entry in 2026
eRacks AI servers run entirely on open-source software, with Ubuntu Linux plus Ollama, Open WebUI, vLLM, and PyTorch pre-installed and tested, so staff reach the AI from a browser on day one, with no per-seat fees and no data leaving the building.
The guide is published at https://eracks.com/guides/private-ai-sizing/. eRacks has built custom open-source servers since 1999 and will size a private AI server to a customer's exact models and user count at no charge.
About eRacks Open Source Systems
eRacks Open Source Systems is an open-source server and storage specialist founded in 1999, headquartered in Fremont, CA, building rackmount servers, NAS, and AI inference servers configured to customer requirements.
Media Contact
Joseph Wolff eRacks Open Source Systems joe@eracks.com https://eracks.com
Source: eRacks Open Source Systems
Filed Under: Computers
0 Comments
Latest on The Californer
- California reaches major milestone in modernizing behavioral healthcare: Proposition 1 goes into effect statewide
- Long Beach Teens Invited to Free Outdoor Youth Connection Camp
- California State Parks pass programs reach major milestones during last week to download the free Historian Passport
- Los programas de pases de los Parques Estatales de California alcanzaron logros importantes en la ultima semana para descargar el Pasaporte Historiador gratuito
- Kasinohai Audit: Most Slots Could Be Affected by Finland's Draft Gambling Rules
- Decode Digital Works Launches Executive Fellows Network for Senior Technology Leaders
- Why More Phoenix Families Are Turning to Private Autopsy Services for Answers
- Case Celebrates 30 Years Of Music With Special Anniversary Performances At Yoshi's Oakland
- Burning Spear, The Movement, & Kabaka Pyramid Headline Reggae on the River 2026
- Industry Leaders Salute Caviar and Keith D. Robinson at BeTrue Studios BET Weekend Event
- Make America French Again Launches National Campaign
- RAS AP Consulting Expands AP Governance & Automation Practice and Named Finalist for Heidelberg Materials SAP Vendor & Customer Data Project
- Plaza Mexico presents 'Golazo Fest III'
- California: Hey, NIMBY Huntington Beach…you tired of losing yet?
- Diffractive networks enable optical information transfer through random and unknown diffusers
- California: El Gobernador Newsom y la Tesorera Estatal Fiona Ma anuncian colaboración con Early Wealth Partnership para facilitar el acceso de las familias a recursos financieros para sus hijos
- Cal State LA earns five-star rating in Money.com's Best Colleges in America rankings
- U.S. Congressional Candidate Pete Verbica on High Costs in California: It's Time to Build a New American Ladder
- Bridge Publications honored with Hermes Gold Award for commemorative edition of the book Dianetics
- Ike's Love & Sandwiches Makes Its Pitch to LeBron James