Data centers are becoming factories whose product is tokens. A deep dive into token economics, the $5.2T buildout, the enterprise cost paradox, and what changes in IT by 2030 — with real numbers.
At GTC 2026, Nvidia's Jensen Huang said the word "token" more than 70 times in a single keynote and gave operators a formula:
Revenue = Tokens per Watt × Available Gigawatts. The claim underneath the theater is structural: the atomic unit of machine reasoning — the token — is becoming a manufactured, graded, priced commodity. The consequence is that between 2026 and 2030, IT stops being organized around applications and storage and reorganizes around three questions:
Every layer — silicon, power, cloud, SaaS, enterprise IT departments, national policy — is being redrawn around those three questions.
Like a mine, a token factory is capacity-constrained by physics: a 1-gigawatt facility is 1 gigawatt, full stop. Yield per unit of energy is the whole game.
Like a commodity, tokens are being graded and tiered. Huang sketched a public price ladder: roughly $1 per million tokens at the low end, $3–6 mid-tier, ~$45 for engineering-grade, with $1,000 per million tokens for premium reasoning positioned as a question of when, not if.
And like early oil, the resource is triggering an infrastructure land-grab, national-security posturing — and a legitimate debate about whether the capex is running ahead of the demand.
Google is the most public benchmark, because it discloses the number at every I/O:
| Date | Tokens / month | What it signals |
|---|---|---|
| Apr 2024 | ~9.7 trillion | Chatbot era — AI as a feature |
| May 2025 | ~480 trillion (50×) | AI Overviews + APIs go mainstream |
| Oct 2025 | ~1.3 quadrillion | Agentic workloads begin compounding |
| May 2026 | ||
| 3.2 quadrillion (7× YoY) | ||
| 19B tokens/minute via API; 375 Google Cloud customers each consuming >1T tokens/year |
These are vendor-reported and unaudited — but the shape of the curve is corroborated elsewhere. Microsoft reported 100T+ tokens in a single quarter of 2025 (5× YoY) and, by its FY26 Q3 call, 300+ Foundry customers on track for a trillion tokens each, accelerating 30% quarter-over-quarter. OpenRouter's annualized routing volume crossed one quadrillion tokens in March 2026. The growth curve is not flattening. This is steep adoption, not saturation.
McKinsey's data-center demand model gives the buildout three scenarios for 2025–2030:
| Scenario | New AI capacity | AI capex to 2030 | Note |
|---|---|---|---|
| Constrained | +78 GW | $3.7T | Efficiency gains + adoption stalls |
| Base case | |||
| +125 GW → 156 GW total | |||
| $5.2T | |||
| ≈ the electricity of 125 nuclear reactors | |||
| Accelerated | +205 GW | $7.9T | Agentic demand outruns efficiency |
Add ~$1.5T for traditional IT workloads and the total approaches $7 trillion by 2030 — roughly 1% of global GDP annually. Of the AI share, ~60% ($3.1T) flows to chips and computing hardware, ~25% ($1.3T) to power, cooling and electrical, ~15% ($0.8T) to land and construction. Global capacity demand nearly triples, from 82 GW (2025) to 219 GW (2030), with AI workloads at ~70% of it.
This is the single most important dynamic for enterprise IT budgets to 2030, and it is a textbook Jevons paradox: efficiency gains don't reduce total consumption — they detonate it.
| Falling ↓ | Rising ↑ |
|---|---|
| Blended enterprise cost per million tokens: $18.40 → $6.07 (−67%) between Q1 2025 and Q1 2026, across an analysis of 2.4B enterprise API calls | |
| Average enterprise AI budget: $1.2M (2024) → $7M (2026); 73% of enterprises exceeded their AI cost projections (FinOps Foundation 2026) | |
| Per-token prices for equivalent capability falling 9×–900×/yr depending on benchmark (Epoch AI); Gartner forecasts a further ~90% reduction by 2030 | Inference now ≈ 80–85% of enterprise AI spend; some Fortune 500 companies report monthly inference bills in the tens of millions |
| Open-source inference costs declining 30–50% annually since 2023 | Agentic workflows consume 5–30× more tokens per task than a chatbot query (Gartner, Mar 2026) |
Huang's GTC 2026 framing was an "Enterprise IT Renaissance" from SaaS to Agent-as-a-Service. The logic chain: if intelligence is metered in tokens, software stops being rented per seat and starts being consumed per unit of work. Nvidia is even piloting token allowances as compensation — Huang floated giving engineers roughly half their base pay as a token budget (a $250K/yr allowance on a $500K salary). Discount the theater; keep the signal: token budgets are entering corporate financial statements as a managed resource, next to headcount and cloud spend.
The counter-view matters equally. For JPMorgan, Walmart, or GM, tokens are a raw material, not a product — their CIOs want cheaper inference and a clear ROI date, not a token-revenue story. Both views are correct; they describe opposite ends of the same value chain.
| Layer | 2026 state | 2030 trajectory |
|---|---|---|
| Energy | ||
| The binding constraint. US data-center demand adding ~460 TWh 2023–2030; grid interconnection queues are the new chip shortage | Power procurement becomes a core IT competency; tokens-per-watt reported the way PUE once was | |
| Silicon | ||
| Annual architecture cadence; inference-specialized parts (SRAM-heavy LPUs claiming ~35× throughput/MW on decode); prefill/decode disaggregation | Heterogeneous fleets tuned per inference phase; ~$3.3T of capex lands here; cost per token keeps falling ~an order of magnitude per year | |
| Data center | ||
| From compute hub to AI factory; gigawatt campuses; 97% occupancy; 77% of the construction pipeline pre-leased | Global capacity ~triples to 219 GW; the industry builds 2× everything built since 2000, in 5 years; revenue per MW is the operator KPI | |
| Cloud | ||
| Token-throughput pricing appears next to VM pricing; neoclouds and GPU-as-a-service proliferate | Cloud sold in three meters: storage (GB), compute (vCPU), intelligence (tokens) | |
| Software / SaaS | ||
| Per-seat pricing eroding; agent step-billing emerges; coding agents approach $1B run-rates, partly driven by people who cannot code | SaaS → AaaS: outcome- and consumption-priced agents; software TAM expands from tool rental to digital-labor delivery | |
| Enterprise IT | ||
| 85% of AI budget is inference; 73% blew their projections; FinOps scrambling | A token P&L per business unit; model-routing gateways as standard infrastructure; "AI cost engineer" becomes a named role | |
| Nation-states | ||
| "Compute = GDP" doctrine; EU AI gigafactories (~€20B via EuroHPC, ~100K-processor facilities); France treats AI sovereignty as presidential-level policy | Token production capacity tracked like energy reserves; sovereignty defined by jurisdiction over execution, not just data residency |
If you build or buy AI in the EU, four things are different — and they matter more every quarter as the AI Act's high-risk rules bite (August 2, 2026):
| Year | What happens |
|---|---|
| 2026 | |
| The quadrillion-token era begins (Google 3.2Q/mo; OpenRouter 1Q annualized). Inference flips profitable at the frontier. Token tiering formalizes. EU AI Act high-risk rules bite August 2. FinOps annexes AI spend | |
| 2027 | |
| Agent step-billing becomes standard in SaaS contracts; first wave of frontier API price normalization upward as VC subsidies recede; token budgets appear as explicit line items; EU gigafactory sites break ground | |
| 2028 | |
| Model-routing gateways are default enterprise infrastructure; LPU-class inference silicon goes mainstream in hyperscaler fleets; power procurement gates more IT roadmaps than chip supply; sovereign inference reaches price-parity for open-weight workloads | |
| 2029 | |
| Consumption/outcome pricing overtakes per-seat in new enterprise software deals; "AI cost engineer" is a hiring category; national token-production capacity is discussed in industrial-policy terms alongside energy | |
| 2030 |
If the base case holds: 219 GW global capacity (~70% AI), ~$7T cumulative capex, ~1% of global GDP flowing annually into the token supply chain. Per-token cost ~90% below 2026 — and total token spend far higher anyway | Govern
Architect
Negotiate & plan
Between 2026 and 2030, IT reorganizes around a single commodity it now manufactures — the token — and the winners on both sides of the market will be the ones who treat tokens-per-watt (producers) and cost-per-outcome (consumers) as first-class engineering disciplines.
Sources: Nvidia GTC 2026 keynote and fiscal Q1 2027 earnings call; Google I/O 2026 keynote (Sundar Pichai); Microsoft FY25–FY26 earnings calls; OpenRouter disclosures (Mar 2026); McKinsey, "The cost of compute" (2025) and subsequent data-center research; FinOps Foundation State of FinOps 2026; Gartner (Mar 2026); Epoch AI benchmarks; SemiAnalysis 2026 research; SiliconANGLE "The token economy: the state of AI mid-2026" (Jul 2026); Forrester 2026 forecast. Vendor-reported token volumes are self-declared and unaudited — treat as directional.
By Soumia, a developer advocate focused on making complex infrastructure legible — through writing, speaking, and helping technical and non-technical audiences find common ground. I work at the intersection of cloud-native systems, AI, and editorial craft. — LinkedIn · Portfolio