DeepGEMM

An engineer benchmarked Qwen3-8B on workstation Blackwell GPUs across three serving stacks, finding that vLLM outperformed SGLang and llama.cpp by up to 4x under load, and that an FP8 pass delivered a…

Helion kernels were integrated into vLLM for FP8 inference using Qwen3 models and evaluated across NVIDIA H100 and B200 GPUs. The experiments demonstrated that Helion provides a productive PyTorch-nat…