Last week a company nobody can name spent $500 million in a single month on Anthropic's Claude API. Not $500K. Not $5M. Half a billion dollars. In one month. Because nobody set a spending limit.
Uber burned through its entire 2026 AI coding budget by April. Four months into the year, done.
Microsoft quietly cancelled its internal Claude Code licenses and told engineers to go back to GitHub Copilot.
All three stories broke within days of each other, and they all point to the same thing. Token-based billing, when given to an ungoverned team, is a financial weapon pointed at your own company. Every prompt, every context window, every agentic loop gets billed. An engineer running Claude Code seriously can rack up $500 to $2,000 a month just by doing their job well.
The answer is not stricter policies. The answer is owning the infrastructure and making tokens free.
This article breaks down exactly how to do that for a 100-person engineering team for under $1 million, with real 2026 hardware prices and honest tradeoffs.
When your team uses Claude Code or any external AI API, you do not own anything. You rent compute by the token. The model is not yours. The data leaves your building on every single request. The bill scales with how well your engineers actually use the tool.
That last part is the trap. The better your engineers get at using AI, the more it costs you. Uber's Claude Code adoption jumped from 32% to 84% of their 5,000-person engineering org. That is a success story that turned into a budget crisis.
Owning the infrastructure flips this completely. The better your engineers get at using AI, the more value you extract from hardware you already paid for.
The setup is straightforward:
Your engineers get unlimited tokens. The only ongoing cost is electricity. Your data never leaves the building.
For 100 engineers doing serious agentic coding work you need enough GPU memory to load a large model and serve multiple concurrent requests without people waiting in line.
H100 PCIe 80GB units are running $25,000 to $30,000 per GPU as of Q1 2026. An 8-GPU server system costs roughly $216,000 to $250,000 fully configured.
| Component | Cost |
|---|---|
| 1x 8-GPU H100 80GB Server | ~$216,000 |
| Networking, rack, storage | ~$25,000 |
| Total | |
| ~$241,000 |
| Component | Unit Cost | Qty | Total |
|---|---|---|---|
| 8x H100 80GB PCIe Server | ~$216,000 | 2 | $432,000 |
| Enterprise networking | ~$15,000 | 1 | $15,000 |
| Rack and power distribution | ~$10,000 | 1 | $10,000 |
| UPS backup power | ~$8,000 | 1 | $8,000 |
| NVMe storage | ~$5,000 | 1 | $5,000 |
| Total | |||
| ~$470,000 |
| Component | Cost |
|---|---|
| 3x 8-GPU H100 Servers + full infra | ~$700,000 |
One server can go down for maintenance while the other two keep serving. Full redundancy under $1M.
You do not train anything. You download weights. The open-source coding model landscape in 2026 is genuinely impressive.
Top tier for agentic coding:
Best overall default:
Lighter options for tighter hardware:
All of these serve an OpenAI-compatible API through vLLM. Claude Code does not know or care whether the model on the other end is hosted by Anthropic or running in your server room.
H100 Servers
Ubuntu 24.04 LTS
vLLM (inference server, OpenAI-compatible)
Model weights from HuggingFace (downloaded once)
Claude Code / Cursor / any agent
(change base_url to your server IP, done)
A software engineer comfortable with Linux and Docker can have this running in a weekend. Not weeks. Not a specialized team. A weekend.
Key tools: vLLM for production inference with automatic batching, Ollama if you want something simpler, Open WebUI for a browser interface your non-CLI teammates will appreciate.
API route (what Uber did):
Conservative estimate of $1,000 per engineer per month in tokens. Uber actually saw $500 to $2,000 per person.
On-premise route:
You save roughly $1.65 million over two years. The hardware pays for itself in under 5 months.
And that is the conservative number. At Uber's real burn rate of $2,000 per engineer per month the savings are much larger.
Spread the $470,000 hardware cost over 10 years and it works out to $47,000 per year. Compare that to $1.2 million per year in API costs.
The scary "1 to 3 year GPU lifespan" stories you may have read are about cloud providers, not you. Google, CoreWeave, and Lambda Labs run their GPUs at 60 to 70 percent utilization continuously, 24/7, to maximize revenue per chip. That is what wears them out fast.
Your situation is completely different. 100 engineers work business hours. They are not all prompting at the same time. Claude Code runs autonomously in focused bursts, not nonstop. Nights, weekends, and holidays the servers are mostly idle. Your whole team is working on the same product so usage is concentrated R&D, not random noise across thousands of unrelated tasks.
Realistically your servers run at 10 to 25 percent average utilization. That is dramatically easier on the hardware.
CoreWeave, which runs GPUs commercially for paying customers at real data center intensity, adopted a 6-year depreciation cycle. Their CEO mentioned that 2020-era A100 chips are still fully booked today, and returned H100s were immediately re-leased at 95 percent of original value.
For your usage profile, realistic estimates look like this:
| What | Lifespan |
|---|---|
| Physically functional | 8 to 12 years |
| Useful for inference workloads | 7 to 10 years |
| Best-in-class speed | 4 to 5 years |
The important thing about model upgrades: you do not need new hardware to get a smarter model. When DeepSeek V6 or Qwen5 ships in 2028 you just download the new weights onto the same servers. The hardware is a compute substrate. The model is software. Your $470K box keeps getting smarter for free every year.
Running your own model kills the token problem. But a real engineering workflow involves more than just a model. Some tools do carry costs:
Things that still cost something:
Things that become completely free:
The token was always the real enemy. Web search at $20 per month is noise. One engineer running serious agentic workflows on an external API for a single month costs more than your entire team's web search bill for a year.
This one is subtle but it might be the most important point in the whole article.
When engineers know every token costs money, they change how they work. They shorten prompts. They avoid feeding large context. They do not try the experimental approach because it feels wasteful. They self-censor before even hitting enter. That is not a productivity tool anymore, that is a productivity tax with extra steps.
Think about how Anthropic engineers work. They built me. They experiment with me constantly, run long agentic sessions, try weird approaches, feed massive context, iterate without counting the cost. That fearlessness is a huge part of why the product keeps getting better. They are not rationing prompts.
When your team owns the infrastructure and tokens are free, your engineers work the same way. Someone wants to feed the entire codebase as context and see what happens? Do it. Someone wants to run 10 different approaches to the same problem and compare outputs? Go ahead. Someone wants to leave an autonomous agent running overnight testing 50 variations of a function? Zero extra cost.
The best engineering breakthroughs often come from experiments that look wasteful on paper. You do not get those experiments when people are watching a token counter.
This is the difference between a team that uses AI carefully and a team that uses AI fearlessly. The fearless team wins.
This is something no external API will ever let you do properly.
Once you own the hardware, you can fine-tune the model on your actual company code, internal architecture docs, your own naming conventions and patterns. The model starts to understand your product specifically. It stops suggesting generic solutions and starts suggesting solutions that fit how your system is actually built.
This compounds over time. Every few months you run another fine-tuning pass on new code your team wrote. The model gets more useful. No extra cost. No data shared with anyone. Just a smarter model that knows your product better than any off-the-shelf API ever could.
Anthropic raises API prices tomorrow? OpenAI changes its terms of service? A new competitor launches with better models?
You do not care. You swap the model weights, same hardware, same workflow, same team. You are not locked into any vendor's pricing, any vendor's policy changes, or any vendor's uptime.
The whole open-source model ecosystem works on your hardware. When something better comes out you just download it. No renegotiating contracts. No migration projects. No asking someone else for permission.
Every prompt your engineers send to an external API contains information about your product. Your architecture decisions. Your business logic. Features you have not shipped yet. Edge cases in your system. Proprietary algorithms.
There is an ongoing debate about how AI companies use API data. Regardless of where you stand on that debate, the cleanest answer is that the data never leaves your building in the first place.
On private infrastructure, your unreleased features stay unreleased. Your competitive advantages stay competitive. Your codebase is yours.
When Anthropic has an infrastructure problem, your engineers stop working. When OpenAI has a bad deploy, your sprint slows down. You are dependent on someone else's reliability for your team's ability to function.
On private infrastructure you own the uptime. Your on-call engineer handles it. You are not refreshing a status page waiting for someone else to fix their problem. For teams in regulated industries this is not optional, it is a requirement.
This is the part nobody wants to say loudly but the data is already saying it.
Uber had 5,000 engineers using Claude Code. By March 2026, 84 percent of them were using it. And they still burned through their annual AI budget in four months. That is not an AI success story. That is 5,000 people with ungoverned access to a metered tool, a lot of them generating noise and spending money on it.
Jack Dorsey cut Block (Square and Cash App) from 10,000 employees to under 6,000 in early 2026. Not because the company was struggling. Their gross profit had climbed 24 percent year-over-year. The stock jumped 24 percent on the announcement. His reasoning was simple: with AI, fewer people produce the same output.
McKinsey data backs this up. AI-centric organizations are seeing 20 to 40 percent reductions in operating costs with faster output, not slower.
The math of lean vs bloated:
| Approach | Team Size | AI Cost/yr | Avg Salary | Total People Cost | Grand Total |
|---|---|---|---|---|---|
| Uber model | 5,000 engineers | $12M+ (tokens) | $150K | $750M | $762M+/yr |
| Private AI model | 100 engineers | ~$137K (year 2+) | $150K | $15M | ~$15.1M/yr |
You hire 100 AI-efficient engineers. Not necessarily the most experienced people, but people who know how to get their work done through AI. Someone who can direct agents, validate output, break down a problem for an autonomous run, and stay unblocked. A two-year engineer who genuinely knows how to use AI will outship a ten-year veteran who treats it as fancy autocomplete.
You give them private unlimited AI. You let autonomous agents handle repetitive work overnight. You hire for the actual project, not for headcount.
The best real-world example of this philosophy is Anthropic itself. Around 1,000 employees, competing directly with Google and Microsoft which each have hundreds of thousands of people. They are not winning because they have more bodies. They are winning because every person is high-leverage and working on what matters. Scale that down to 100 engineers for your product and you have the template.
One competent engineer who knows Linux and Docker. One weekend. That is the setup cost.
The $500M bill was not bad luck. It was the predictable result of giving thousands of people unlimited access to a metered service with no ownership and no governance. The solution is not more policies. It is owning the infrastructure, removing the meter, and building with a team small enough to actually manage.
Under $1 million. Running in a weekend. Tokens free forever. Your data stays yours. Your model learns your codebase. No vendor can change the price on you.
Someone should have told Uber.
The news stories this article is based on:
Hardware pricing (Q1-Q2 2026):
GPU lifespan data:
Open source models (May 2026):
Team size and AI efficiency: