cd /news/large-language-models/qwen-3-8-flash-next-nvfp4-on-a-singl… · home › topics › large-language-models › article
[ARTICLE · art-114611] src=forum.level1techs.com ↗ pub= topic=large-language-models verified=true sentiment=↑ positive

Qwen 3.8 Flash Next NVFP4 on a single RTX Pro 6000 and system memory

A user benchmarked the Qwen 3.8 Flash Next NVFP4 model on a single RTX Pro 6000 GPU, achieving 81-88 tokens per second in a single session and scaling to 341 tokens per second with six concurrent clients. The model requires 100GB of system memory for its 51B n-gram table, with prompt preprocessing compute-bound at 12,000 tokens per second even at 100k context.

read1 min views3 publishedAug 28, 2026
Qwen 3.8 Flash Next NVFP4 on a single RTX Pro 6000 and system memory
Image: Forum (auto-discovered)

Followed the documentation on primitive-ai/Qwen3.8-Flash-Next-NVFP4 · Hugging Face Here is my full report Claude Artifact . Basic 81- 88 tokens per second on a single session. Scales to a throughput of 341 tokens per second when running 6 concurrent client. Interesting piece is the prompt preprocessing is GPU compute bound at 12000 tokens per second even when context is scaled up to 100k. This model rules but you need to have 100GB spare system memory to hold the 51B n-gram table.

1 Like

source & further reading
forum.level1techs.com — original article When Is It Worth Personally Preparing for AI Disasters? What should the EA community be doing now that the (AIS) Overton window has opened up again? Money Pumps for Agents Who Are Ambiguity Averse or Ambiguity Seeking
── more in #large-language-models 4 stories · sorted by recency
── more on @qwen 3.8 flash next nvfp4 3 stories trending now
sponsored brought to you by zahid.host 4,200+ EU-deployed projects
reading about agents? ship yours in a single git push.

Run your AI side-project on zahid.host

EU-based hosting, git-push deploys, automatic HTTPS, no cold starts. Free tier with a custom domain — perfect for shipping the agent you just read about.

$git push zahid main
→ Live at https://your-agent.zahid.host ✓
Get free account → Pricing
from €0/mo · no card required
LIVE [news/qwen-3-8-flash-next-…] indexed:0 read:1min 2026-08-28 · —