cd /news/large-language-models/qwen3-8-flash-next-180b-running-in-r… · home › topics › large-language-models › article
[ARTICLE · art-171393] src=twitter.com ↗ pub= topic=large-language-models verified=true sentiment=↑ positive

Qwen3.8-Flash-Next 180B running in real time on a 16G MacBook Pro

A 180B-parameter Qwen3.8-Flash-Next model ran fully offline in real time on a 16 GB MacBook Pro using just 9 GB of RAM, with the remaining 112 GB of weights offloaded to the laptop's SSD, according to a post by Jalen Lu on X. Lu said the approach avoids the usual speed penalty of disk offloading by changing when the model knows which weights it needs, though each token still pulls 500 to 700 MB from the SSD, making the drive the bottleneck. Lu argued a frontier model could be designed to be "prefetchable" from the start through native training.

recommendation

When serving a model larger than available RAM, offload weights to SSD but schedule prefetch ahead of token generation; the source still measured 500-700 MB of SSD reads per token, so drive bandwidth caps throughput.

more in playbook: Inference and self-hosting
read2 min views4 publishedNov 17, 2026
Qwen3.8-Flash-Next 180B running in real time on a 16G MacBook Pro
Image: source

Jalen Lu on X: "This is a 180B-parameter model running in real time on just a 16 GB MacBook Pro! Qwen3.8-Flash-Next, fully offline, using just 9 GB of RAM, doing agentic tasks in OpenCode at usable speeds. The other 112 GB of weights are offloaded to the laptop’s SSD, with a new method that doesn’… / X

Jalen Lu on X: "This is a 180B-parameter model running in real time on just a 16 GB MacBook Pro! Qwen3.8-Flash-Next, fully offline, using just 9 GB of RAM, doing agentic tasks in OpenCode at usable speeds. The other 112 GB of weights are offloaded to the laptop’s SSD, with a new method that doesn’t pay the usual speed penalty."

This is a 180B-parameter model running in real time on just a 16 GB MacBook Pro! Qwen3.8-Flash-Next, fully offline, using just 9 GB of RAM, doing agentic tasks in OpenCode at usable speeds. The other 112 GB of weights are offloaded to the laptop’s SSD, with a new method that doesn’t pay the usual speed penalty.

This is a 180B-parameter model running in real time on just a 16 GB MacBook Pro! Qwen3.8-Flash-Next, fully offline, using just 9 GB of RAM, doing agentic tasks in OpenCode at usable speeds. The other 112 GB of weights are offloaded to the laptop’s SSD, with a new method that doesn’t pay the usual speed penalty.

Off a model to disk isn’t new. llama.cpp and others will memory-map a model bigger than your RAM. But the model only finds out which weights it needs at the moment it needs them, so the GPU sits and waits on the drive. We changed when the model knows. Qwen3.8-Flash-NextShow more

Even then, this model was never built to be read off a drive. Each token still pulls 500 to 700 MB from the SSD, so the laptop’s drive sets the speed. But the ceiling is much higher than this! A frontier model can be designed to be “prefetchable” from the start: natively trainedShow more

── more in #large-language-models 4 stories · sorted by recency
── more on @qwen3.8-flash-next 3 stories trending now
sponsored brought to you by zahid.host 4,200+ EU-deployed projects
reading about agents? ship yours in a single git push.

Run your AI side-project on zahid.host

EU-based hosting, git-push deploys, automatic HTTPS, no cold starts. Free tier with a custom domain — perfect for shipping the agent you just read about.

$git push zahid main
→ Live at https://your-agent.zahid.host ✓
Get free account → Pricing
from €0/mo · no card required
LIVE [news/qwen3-8-flash-next-1…] indexed:0 read:2min 2026-11-17 · —