15:08
2026-07-27
lesswrong.com
artificial-intelligence
Quadrillion Param Costs: KV Cache, Context Length, Frontier Margins
A new analysis predicts that AI models will grow from 10 trillion parameters in 2026 to 1.4 quadrillion parameters by 2031, with inference costs remaining surprisingly low due to KV cache scaling. The…