# Qwen3.8-Flash-Next 180B running in real time on a 16G MacBook Pro

> Source: <https://twitter.com/jalenluorion/status/2122758656668184633>
> Published: 2026-11-17 22:16:15+00:00

**Recommendation:** When serving a model larger than available RAM, offload weights to SSD but schedule prefetch ahead of token generation; the source still measured 500-700 MB of SSD reads per token, so drive bandwidth caps throughput.
More in the playbook "Inference and self-hosting": <https://wpnews.pro/playbooks/inference-serving>

Jalen Lu on X: "This is a 180B-parameter model running in real time on just a 16 GB MacBook Pro!
Qwen3.8-Flash-Next, fully offline, using just 9 GB of RAM, doing agentic tasks in OpenCode at usable speeds. The other 112 GB of weights are offloaded to the laptop’s SSD, with a new method that doesn’… / X

Jalen Lu on X: "This is a 180B-parameter model running in real time on just a 16 GB MacBook Pro!
Qwen3.8-Flash-Next, fully offline, using just 9 GB of RAM, doing agentic tasks in OpenCode at usable speeds. The other 112 GB of weights are offloaded to the laptop’s SSD, with a new method that doesn’t pay the usual speed penalty."

This is a 180B-parameter model running in real time on just a 16 GB MacBook Pro!
Qwen3.8-Flash-Next, fully offline, using just 9 GB of RAM, doing agentic tasks in OpenCode at usable speeds. The other 112 GB of weights are offloaded to the laptop’s SSD, with a new method that doesn’t pay the usual speed penalty.

This is a 180B-parameter model running in real time on just a 16 GB MacBook Pro!
Qwen3.8-Flash-Next, fully offline, using just 9 GB of RAM, doing agentic tasks in OpenCode at usable speeds. The other 112 GB of weights are offloaded to the laptop’s SSD, with a new method that doesn’t pay the usual speed penalty.

Offloading a model to disk isn’t new. llama.cpp and others will memory-map a model bigger than your RAM.
But the model only finds out which weights it needs at the moment it needs them, so the GPU sits and waits on the drive.
We changed when the model knows. Qwen3.8-Flash-NextShow more

Even then, this model was never built to be read off a drive. Each token still pulls 500 to 700 MB from the SSD, so the laptop’s drive sets the speed.
But the ceiling is much higher than this! A frontier model can be designed to be “prefetchable” from the start: natively trainedShow more
