15:44
2026-07-27
vllm.ai
artificial-intelligence
Kimi K3 on vLLM: Up to 370 Tokens/sec
VLLM announces efficient day-0 support for Moonshot AI's Kimi K3, a 2.8-trillion-parameter Mixture-of-Experts model, achieving up to 370 tokens per second with speculative decoding on 16 NVIDIA GB300 …