Trending...
- Eddy Corp and SMAART POWER LLC Announce Strategic Teaming Agreement to Accelerate Microgrid and Distributed Energy Deployments - 342
- California: Governor Newsom signs most comprehensive data center laws in the nation, providing communities more control on water, electricity, and land use - 115
- Attn: Every Business in the Universe: This Advertising Math can help all kinds of Businesses make a lot more Money a lot faster! Start using it Today! - 108
Plain-English guidance on how much GPU memory and system RAM each model size needs, when self-hosting beats cloud APIs, and how to keep AI data entirely in-house.
FREMONT, Calif. - Californer -- eRacks Open Source Systems today published "Private AI, Sized & Priced," a vendor-neutral buyer's guide for organizations that want to run large language models on their own hardware rather than through a cloud API, and announced that a 70-billion-parameter model now runs on-premise on its AILSA server starting at $5,995.
The guide answers the question eRacks hears most from AI buyers: how big a machine do I actually need? AI servers are priced largely by GPU memory (VRAM). The guide gives a model-size-to-VRAM table (a 70B model in 4-bit quantization needs roughly 42 GB, about 80 GB in 8-bit), and adds the part most buyers miss: system RAM should be 1.5 to 2 times the VRAM, and a multi-GPU server needs a server-class CPU for the PCIe lanes.
It also lays out the cost crossover where owning beats renting. A 30-person team paying $30 per user per month for a cloud AI service spends about $10,800 a year, every year, with all prompts transiting a third party's servers. An on-premise server covers the same everyday inference and pays for itself in under a year. For teams handling protected health information, attorney-client material, government data, or unpublished research, the calculus is simpler still: the data cannot leave their control, and a private server is the only option.
More on The Californer
eRacks AI servers run entirely on open-source software, with Ubuntu Linux plus Ollama, Open WebUI, vLLM, and PyTorch pre-installed and tested, so staff reach the AI from a browser on day one, with no per-seat fees and no data leaving the building.
The guide is published at https://eracks.com/guides/private-ai-sizing/. eRacks has built custom open-source servers since 1999 and will size a private AI server to a customer's exact models and user count at no charge.
About eRacks Open Source Systems
eRacks Open Source Systems is an open-source server and storage specialist founded in 1999, headquartered in Fremont, CA, building rackmount servers, NAS, and AI inference servers configured to customer requirements.
Media Contact
Joseph Wolff eRacks Open Source Systems joe@eracks.com https://eracks.com
The guide answers the question eRacks hears most from AI buyers: how big a machine do I actually need? AI servers are priced largely by GPU memory (VRAM). The guide gives a model-size-to-VRAM table (a 70B model in 4-bit quantization needs roughly 42 GB, about 80 GB in 8-bit), and adds the part most buyers miss: system RAM should be 1.5 to 2 times the VRAM, and a multi-GPU server needs a server-class CPU for the PCIe lanes.
It also lays out the cost crossover where owning beats renting. A 30-person team paying $30 per user per month for a cloud AI service spends about $10,800 a year, every year, with all prompts transiting a third party's servers. An on-premise server covers the same everyday inference and pays for itself in under a year. For teams handling protected health information, attorney-client material, government data, or unpublished research, the calculus is simpler still: the data cannot leave their control, and a private server is the only option.
More on The Californer
- AMIClubwear Unveils Its 2026 Halloween Costume Collection — Sexy, Affordable Looks for Women
- Dion Abadi Publishes Free Collector Tips Hub for Art and Jewelry Buyers
- California: Governor Newsom signs legislation protecting the LGBTQ community, pushing back on attacks by the Trump administration
- 1017 Brick Squad Records Announces The Signing Of Uneekint And Gepetto Jackson
- Ship Overseas Inc Expands Superyacht and Boat Ocean Transport Services to Global Hubs
eRacks AI servers run entirely on open-source software, with Ubuntu Linux plus Ollama, Open WebUI, vLLM, and PyTorch pre-installed and tested, so staff reach the AI from a browser on day one, with no per-seat fees and no data leaving the building.
The guide is published at https://eracks.com/guides/private-ai-sizing/. eRacks has built custom open-source servers since 1999 and will size a private AI server to a customer's exact models and user count at no charge.
About eRacks Open Source Systems
eRacks Open Source Systems is an open-source server and storage specialist founded in 1999, headquartered in Fremont, CA, building rackmount servers, NAS, and AI inference servers configured to customer requirements.
Media Contact
Joseph Wolff eRacks Open Source Systems joe@eracks.com https://eracks.com
Source: eRacks Open Source Systems
Filed Under: Computers
0 Comments
Latest on The Californer
- the Bad Society Model Music Leak Was Just The Beginning:
- World-Renowned Body Language Expert Mark Bowden Headlines INSPIRE Northwest 2026 in Wenatchee, WA
- New 'What Can Kill Me' App Helps Users Spot Hazards Before They Encounter Them
- Governor Newsom signs legislation supporting California Native AmericansGovernor Newsom signs legislation supporting California Native Americans
- California: Governor Newsom proclaims Native American Day
- ASN Software Introduces New California CARS Act Dealer Updates
- USA Air Management Marks 30 Years of Air Duct Cleaning in NJ Urges Homeowners to Schedule Dryer Vent Cleaning Before Heating Season
- Dr. Jay Johannigman Returns to Cincinnati Following 46 Years of Military Service
- California: Governor Newsom signs "Braun's Law," and package of bills to crack down on DUI offenders
- Allstream Energy Partners, SEO Experts in Oil and Gas, Awarded Gas Processing OEM Agreement
- Governor Newsom signs bills to keep strengthening security and safe access for California's faith and nonprofit communities
- Growth Story Expands: $54.6M Contract, $30M Revenue Run Rate, 800+ Customers, 50+ Patents & New AI Cybersecurity Products for Cycurion, Inc $CYCU
- Sky Quarry Restarts Nevada's Only Crude Oil Refinery — A Major New Chapter Begins in This Highly Lucrative sector for N A S D A Q: SKYQ
- Nutriband Inc. (N A S D A Q: NTRB) Breaks Into Uncharted Territory: 52-Week High Eclipsed as Shares Surge 22% —AVERSA™ Puts Investors on High Alert
- FabricLoop Opens a Team Workspace That Keeps Messaging, Tasks, Notes, and Calls in One Thread
- Long Beach Health Department Reports First West Nile Virus Death Since 2017
- City of Long Beach Reaches Tentative Three-Year Labor Agreement with IBEW
- California: Governor Newsom applauds federal film and TV tax credit bill, answering his call to keep production in America
- Noted Political Commentator a Major Influencer with multiple Millions of Viewers
- Marissa Goodbody's The Sloth, the Shrew, & the Cockatoo Takes Young Readers on a Rhyming Adventure