Trending...
- Iconic Van Peebles, Immigrant Tech Genius, Champion's Champion Bill Patterson Stories at OIFF - 198
- DuoKey launches the World's First Agentic Crypto Agility Platform - 181
- Sensory Education launches new neuro-affirming psychoeducation book, Sensory Diversity - 134
Plain-English guidance on how much GPU memory and system RAM each model size needs, when self-hosting beats cloud APIs, and how to keep AI data entirely in-house.
FREMONT, Calif. - Californer -- eRacks Open Source Systems today published "Private AI, Sized & Priced," a vendor-neutral buyer's guide for organizations that want to run large language models on their own hardware rather than through a cloud API, and announced that a 70-billion-parameter model now runs on-premise on its AILSA server starting at $5,995.
The guide answers the question eRacks hears most from AI buyers: how big a machine do I actually need? AI servers are priced largely by GPU memory (VRAM). The guide gives a model-size-to-VRAM table (a 70B model in 4-bit quantization needs roughly 42 GB, about 80 GB in 8-bit), and adds the part most buyers miss: system RAM should be 1.5 to 2 times the VRAM, and a multi-GPU server needs a server-class CPU for the PCIe lanes.
It also lays out the cost crossover where owning beats renting. A 30-person team paying $30 per user per month for a cloud AI service spends about $10,800 a year, every year, with all prompts transiting a third party's servers. An on-premise server covers the same everyday inference and pays for itself in under a year. For teams handling protected health information, attorney-client material, government data, or unpublished research, the calculus is simpler still: the data cannot leave their control, and a private server is the only option.
More on The Californer
eRacks AI servers run entirely on open-source software, with Ubuntu Linux plus Ollama, Open WebUI, vLLM, and PyTorch pre-installed and tested, so staff reach the AI from a browser on day one, with no per-seat fees and no data leaving the building.
The guide is published at https://eracks.com/guides/private-ai-sizing/. eRacks has built custom open-source servers since 1999 and will size a private AI server to a customer's exact models and user count at no charge.
About eRacks Open Source Systems
eRacks Open Source Systems is an open-source server and storage specialist founded in 1999, headquartered in Fremont, CA, building rackmount servers, NAS, and AI inference servers configured to customer requirements.
Media Contact
Joseph Wolff eRacks Open Source Systems joe@eracks.com https://eracks.com
The guide answers the question eRacks hears most from AI buyers: how big a machine do I actually need? AI servers are priced largely by GPU memory (VRAM). The guide gives a model-size-to-VRAM table (a 70B model in 4-bit quantization needs roughly 42 GB, about 80 GB in 8-bit), and adds the part most buyers miss: system RAM should be 1.5 to 2 times the VRAM, and a multi-GPU server needs a server-class CPU for the PCIe lanes.
It also lays out the cost crossover where owning beats renting. A 30-person team paying $30 per user per month for a cloud AI service spends about $10,800 a year, every year, with all prompts transiting a third party's servers. An on-premise server covers the same everyday inference and pays for itself in under a year. For teams handling protected health information, attorney-client material, government data, or unpublished research, the calculus is simpler still: the data cannot leave their control, and a private server is the only option.
More on The Californer
- Amaris Mint® Confirms UK Availability of Swedish-Made BioBoost Daily Nutrition Range
- 99Websites Launches \$99 Done-for-You Website Service for Busy Professionals and Small Businesses
- Yalil Guerra's "Clave" to Receive World Premiere in New Symphonic Version at The Soraya
- solar bus stop led lighting for NCTD at 18 locations
- At 70, LA Woman Launches New E-Commerce Store One Year After Nerve Damage Left Her Unable to
eRacks AI servers run entirely on open-source software, with Ubuntu Linux plus Ollama, Open WebUI, vLLM, and PyTorch pre-installed and tested, so staff reach the AI from a browser on day one, with no per-seat fees and no data leaving the building.
The guide is published at https://eracks.com/guides/private-ai-sizing/. eRacks has built custom open-source servers since 1999 and will size a private AI server to a customer's exact models and user count at no charge.
About eRacks Open Source Systems
eRacks Open Source Systems is an open-source server and storage specialist founded in 1999, headquartered in Fremont, CA, building rackmount servers, NAS, and AI inference servers configured to customer requirements.
Media Contact
Joseph Wolff eRacks Open Source Systems joe@eracks.com https://eracks.com
Source: eRacks Open Source Systems
Filed Under: Computers
0 Comments
Latest on The Californer
- Governor Gavin Newsom on California securing massive victory for democracy
- Della continues to shine with her new release, Now Breathe featuring Angel Sessions
- Citrus Heights-Based Antgava Focuses on Realistic Results in Upholstery Cleaning
- City of Long Beach to Hold Moment of Silence in Remembrance of 9/11 Terrorist Attacks
- Patented Foodservice Products Company with Strong Gross Margins and Substantial Two-Year Revenue Growth Hits Market for $1.6 Million
- Pervaziv AI Introduces Smarter Context Compaction in Cortex, Advancing Reliable Long Running Enterprise AI
- Robert DeMaio, Phinge CEO to Speak at 30th IIPLA 2026 on Securing IP, User Data & Digital Sovereignty via Verified App-less Tech. Attend the Live Q&A!
- California's public safety strategy works: Governor Newsom's commitment helps lower crime as new study shows violence prevention saves lives
- Dividend Stacker Launches Free Calendar and Alerts for High-Yield ETF Payouts
- California: Six years after Creek Fire, Governor Newsom recognizes historic nighttime CalGuard rescue that saved 242 lives
- Paul Ohana - From Beverly Hills Salon Chair To Beauty Founder Celebrity Hair Expert
- MSI Tax, Accounting and Finance Outlines Tax Preparation Ahead of October 15 Extension Deadline
- ChargeOn Announces Conversational Payment Management Solution
- California and the Australian state of Queensland ink new partnership to accelerate climate resilience, agricultural technology, and innovation
- TitleChain Foundation Opens Sovereign AI & Digital Asset Commons, Invites Builders
- King Larry Steps Into His Moment With Music, Major Performances and a Story Built on Persistence
- California: Governor, First Partner statement on the passing of Gloria Steinem
- AristoPup Grooming Welcomes Veteran Groomer Rose Lenk to Growing Mobile Grooming Team
- Church Tradition Takes an Unexpected Turn at the Ford Community & Performing Arts Center
- California prioritized fighting organized retail theft, those results are paying off with 36,000 arrests and $293 million in stolen goods recovered