cd /news/ai-chips/epoch-ais-new-index-says-flop-s-badl… · home › topics › ai-chips › article
[ARTICLE · art-171999] src=cryptobriefing.com ↗ pub= topic=ai-chips verified=true sentiment=· neutral

Epoch AI’s new index says FLOP/s badly undersells modern AI chips

Epoch AI launched its Inference Performance Index (IPI) Version 1 on November 9, 2026, finding that Nvidia's GB300 delivers roughly 25 times the inference capacity of the H100 despite only about 2.5 times the eight-bit FLOP/s — a tenfold gap between spec sheets and measured performance. A November 18 follow-up applied the index to the installed base and found agentic inference capacity grew 4.6 times from Q2 2025 to Q2 2026, versus 2.6 times for compute, with Nvidia's Blackwell GPUs driving 74% of the capacity increase. The index normalizes results to the GB300 NVL72 at 1.0 in a unit called GB300e, scoring the MI455X highest at 2.89, ahead of the VR200 at 2.18, the MI355X at 0.55, the B300 HGX at 0.54 and the H200 HGX at 0.12.

recommendation

Evaluate inference hardware with simulated concurrent-request capacity at 50-400 tokens per second per request rather than FLOP/s alone, since memory bandwidth and interconnect can shift rankings by up to 10x.

more in playbook: Inference and self-hosting
by read3 min views6 publishedNov 18, 2026
Epoch AI’s new index says FLOP/s badly undersells modern AI chips
Image: Cryptobriefing (auto-discovered)

The Inference Performance Index finds agentic inference capacity grew 4.6 times in a year, well ahead of raw compute growth

For years, the AI hardware world has kept score with one number: FLOP/s, or how many floating-point calculations a chip can perform each second. Epoch AI thinks that number has been telling only part of the story. The AI research organization launched its Inference Performance Index (IPI) Version 1 on November 9, 2026. Its first major finding is that Nvidia’s GB300 delivers approximately 25 times the inference capacity of the H100, despite offering only about 2.5 times the eight-bit FLOP/s.

That is a tenfold gap between what the spec sheet suggests and what the index measures.

What the index actually measures #

The IPI focuses on inference, the work a model does when it answers a request, rather than training. More specifically, it targets agentic workloads, where AI systems carry out multistep tasks.

In technical terms, Epoch AI simulates how many concurrent requests a system can handle across a range of output speeds. Its capacity curves run from 50 to 400 tokens per second per request.

The index also accounts for factors that FLOP/s ignores entirely. Those include memory bandwidth, communication between chips, and compute capability. Memory bandwidth governs how quickly a chip can feed data to its processors, while inter-chip communication determines how well many chips work together as one system.

Those details matter more as models handle long context inputs, which the index treats as a key consideration.

The scoreboard #

Epoch AI normalizes every result to Nvidia’s GB300 NVL72, which receives a score of 1.0 in a unit the organization calls GB300e. Everything else is measured relative to that baseline.

AI, tech, and the markets they move—in one daily briefing.

Daily. Free. Join 34,000+ readers across crypto, finance, and policy.

The scores look like this:

- H200 HGX: 0.12
- B300 HGX: 0.54
- MI355X: 0.55
- GB300 NVL72: 1.0
- VR200: 2.18
- MI455X: 2.89

The H200 HGX lands at roughly an eighth of the GB300 NVL72’s capacity. The MI355X and B300 HGX sit almost neck and neck, separated by a hundredth of a point. Meanwhile, the MI455X posts the highest score on the list at 2.89, ahead of the VR200 at 2.18.

Capacity is growing faster than compute #

A follow-up announcement on November 18 applied the index to the broader installed base. Epoch AI found that agentic inference capacity grew 4.6 times from Q2 2025 to Q2 2026.

Over the same window, compute grew 2.6 times. So the ability to actually serve agentic AI requests expanded considerably faster than the raw calculation power behind it.

Nvidia’s Blackwell GPU series drove 74% of that increase in inference capacity.

Epoch AI built the methodology on Nvidia’s AISimulate projections and published its code on GitHub.

Why a better yardstick matters #

If inference capacity diverges from FLOP/s by as much as the GB300 and H100 comparison suggests, then compute-only comparisons could steer buyers toward the wrong conclusions. The IPI gives them a figure closer to the job they actually need done: serving lots of users at usable speeds. The MI355X matching the B300 HGX, and the MI455X topping the list outright, show that rivals can compete when the measurement captures memory and interconnect rather than raw arithmetic alone.

The index relies on simulation rather than live production traffic, and its projections come from Nvidia’s own AISimulate tool while results are normalized to an Nvidia system. The open GitHub release gives competitors and independent researchers a way to test whether the curves hold up.

It is also labeled Version 1, which signals the methodology may evolve.

Disclosure: This article was edited by Diego Almada Lopez. For more information on how we create and review content, see our Editorial Policy.

── more in #ai-chips 4 stories · sorted by recency
── more on @epoch ai 3 stories trending now
sponsored brought to you by zahid.host 4,200+ EU-deployed projects
reading about agents? ship yours in a single git push.

Run your AI side-project on zahid.host

EU-based hosting, git-push deploys, automatic HTTPS, no cold starts. Free tier with a custom domain — perfect for shipping the agent you just read about.

$git push zahid main
→ Live at https://your-agent.zahid.host ✓
Get free account → Pricing
from €0/mo · no card required
LIVE [news/epoch-ais-new-index-…] indexed:0 read:3min 2026-11-18 · —