cd /news/ai-infrastructure/vllm-update-brings-deepseek-v4-1-fla… · home › topics › ai-infrastructure › article
[ARTICLE · art-171144] src=runtimewire.com ↗ pub= topic=ai-infrastructure verified=true sentiment=↑ positive

vLLM update brings DeepSeek V4.1-Flash to eight A100 GPUs

A specialized decode package from NVIDIA engineer Yaoyao Ding was merged into vLLM main on November 16th, enabling DeepSeek-V4.1-Flash to run on a single eight-A100 node; before the merge, the model did not run on A100. Ding reports 488.8 P90 tokens per second per user on H100 against an InferenceX line of 323.6, using different configurations.

read1 min views1 publishedNov 17, 2026
vLLM update brings DeepSeek V4.1-Flash to eight A100 GPUs
Image: Runtimewire (auto-discovered)

Merged on November 16th, the decode path adds A100 support. The contributor reports 488.8 P90 tokens per second per user on H100 against an InferenceX line of 323.6, using different configurations.

        By [RuntimeWire Staff](https://runtimewire.com/author/runtimewire-staff)
        · Published 
        · Updated 

DeepSeek-V4.1-Flash can now run on a single eight-A100 node in vLLM, after a specialized decode package from NVIDIA engineer Yaoyao Ding was merged into vLLM main on November 16th.

Ding's GitHub profile lists him as an engineer at NVIDIA who previously worked at CentML, AWS and MIT HAN Lab, with a computer science PhD from the University of Toronto and an ACM Honors Class background at Shanghai Jiao Tong University. The contribution is kernel work, not a product launch: before the merge, DeepSeek-V4.1-Flash did not run on A100.

Why A100 was locked out…

── more in #ai-infrastructure 4 stories · sorted by recency
── more on @vllm 3 stories trending now
sponsored brought to you by zahid.host 4,200+ EU-deployed projects
reading about agents? ship yours in a single git push.

Run your AI side-project on zahid.host

EU-based hosting, git-push deploys, automatic HTTPS, no cold starts. Free tier with a custom domain — perfect for shipping the agent you just read about.

$git push zahid main
→ Live at https://your-agent.zahid.host ✓
Get free account → Pricing
from €0/mo · no card required
LIVE [news/vllm-update-brings-d…] indexed:0 read:1min 2026-11-17 · —