11:44
2026-09-24
modal.com
ai-infrastructure
How to serve trillions of tokens for trillion-parameter coding agents
Modal detailed how it scaled inference for Moonshot AI's Kimi K2.6 coding-agent model, achieving 2.8x per-user and 5.6x across-user performance gains per replica, with one service processing hundreds …