Mercury 2.5 Diffusion LLM: 1,107 t/s in Production Now

Inception Labs shipped Mercury 2.5 on September 8 — a diffusion language model generating 1,107 tokens per second on commodity NVIDIA GPUs at $0.04 per million input tokens. For teams running voice agents, real-time search, or high-volume RAG pipelines, that combination breaks what developers have accepted as the speed-quality tradeoff in the budget LLM tier. What Mercury 2.5 Actually Does Differently Most LLMs — GPT-6, Claude Fable, Llama — are autoregressive: they generate one token at a time, left to right, each token dependent on the one before it. That sequential dependency is the fundamental throughput ceiling, regardless of how […]

The post