DeepSeek-V4.1-Flash on Vera Rubin NVL72: 58x Throughput vs. GB300 NVL72 at 387 tokens/s
VLLM reports that a single NVIDIA Vera Rubin NVL72 rack serves DeepSeek-V4.1-Flash at 1.7M tokens/s per GPU with 387 tokens/s per user, 58x the throughput of a GB300 NVL72 rack, reaching 2.52M tokens/s at peak throughput…