InferenceX

SGLang achieved a 5x throughput improvement for serving DeepSeek-V4 on NVIDIA GB300 hardware since its Day-0 launch, reaching ~11,200 tok/s/GPU at 50 tok/s/user through kernel and runtime optimization…

DeepSeek v4, an open-source model from a Chinese lab, achieved a 100x performance improvement on AMD hardware within 26 days of its Day 0 release, driven by the AMD SGLang engineering team. The Infere…