Can Qwen 3.8 running on your laptop really replace Claude Opus for Agentic coding? A developer reports that Qwen 3.8 27b, a locally run open-source model, now matches frontier cloud models like Claude Opus 4.6 for agentic coding tasks, scoring 34 versus 32 on the Artificial Analysis index at the xhigh setting. Running on a consumer laptop without cloud dependency, the model completed a substantial feature implementation on the Rust project LlamaStash, though with slow prefill and roughly 10-15 tokens per second decode speeds. The developer says the local model's output quality is on par with Opus 4.6, with a frontier model used only for review. Originally published at deepu.tech https://deepu.tech/local-ai-qwen3.8-pi-llamastash/ . When the whole AI coding frenzy started, I was still skeptical. Like most tech enthusiasts, I tried it but wasn't that impressed by the models' coding capabilities back then. I still used them, but mostly as an autocomplete tool in VS Code. This all changed for me with Opus 4.6 on Claude Code. That was the first time I felt like the model was actually more efficient and smarter than me at coding most of the time. Of course it still needed some hand holding and made silly mistakes at times, but overall I felt the speed of implementing features and fixing bugs was much faster than me doing it alone. I was hooked. I started using it for all my coding tasks and even started to use it for some of my personal projects. I was amazed at how much faster I could get things done with the help of the model. This was around February or March of 2026. Around six months have passed since, and right now there is a local model running on the laptop implementing a huge feature on LlamaStash https://github.com/llamastash/llamastash a complex and huge Rust project as I write this blog post. Now I'm exclusively using local models for most of the coding I do. It's crazy to think that the open source LLMs from Chinese labs that can fit on consumer GPUs have caught up to the frontier models from American companies that need massive data centers to run 😉. And even more impressive is that I can run these powerful models on my laptop without any cloud dependency, which is way greener and wastes less energy. A huge thanks to the Chinese labs for making this possible and for making them open source. In this post, I will show you how I run Qwen 3.8 on my laptop and how it compares to frontier models like Claude Opus for agentic coding. When Qwen 3.6 27b was released, I was excited and impressed by its capabilities. I tried some light coding with it. While it was good, it never felt like a replacement for a frontier model like Claude Opus, as it lacked the quality and was slow on top. I was still using Claude/Kimi/GLM etc for most of my coding tasks, with Qwen 3.6 for small offline tasks, housekeeping etc. But when Qwen 3.8 27b was released, I was blown away by its quality. It was able to understand complex coding tasks and provide accurate solutions. It was also able to understand the context of the code and provide suggestions accordingly. I started using it for some of my main coding tasks and the results were phenomenal. Of course it was still very slow with long prefill times and 10-15 tokens/sec average decode, but personally that wasn't a problem for me since I could give it a task and let it run for a few hours or even overnight, and it finished the tasks at quality on par with Opus 4.6. That seems to be the community conclusion as well: on the Artificial Analysis index https://artificialanalysis.ai/?models=glm-5-3-flash%2Cgpt-6-astra%2Cclaude-fable-5-1%2Cgpt-5-6-luna%2Cclaude-opus-4-6-adaptive%2Cdeepseek-v4-pro%2Cqwen3-8-2-4t-a95b%2Cclaude-opus-4-8%2Cqwen3-8-flash-next%2Cqwen3-8-27b%2Cclaude-opus-5%2Cgpt-5-6-terra%2Cglm-5-3%2Cgpt-5-6-sol%2Cclaude-opus-4-7%2Ckimi-k3 charted below, the 27b at xhigh scores 34 against 32 for Opus 4.6. Most of the coding I do is open source, so the model taking more time than a frontier cloud model wasn't an issue for me. It did take some tuning and setup more on that below , and it did go on a loop a few times, crashed mid session a few times probably an issue with my power supply and would need some hand holding to resume, but overall it was able to complete most of the tasks with minimal intervention. I was impressed by its capabilities and started using it for more complex tasks, with a frontier model like Opus 5 reviewing its output. Here https://github.com/llamastash/llamastash/pull/71 is the first serious task I gave it and the results I got. It created a plan and one shotted the implementation. See the review comments from Opus 5, they were mostly nits, and Qwen 3.8 27b fixed those in the next commit. I was extremely impressed because the project, LlamaStash https://github.com/llamastash/llamastash , was a complex one and had a huge Rust codebase, but Qwen 3.8 27b was able to understand the codebase and implement the feature with minimal intervention. I started using it for more work https://github.com/llamastash/llamastash/pulls?q=is%3Apr+is%3Aclosed+label%3A%22By+Qwen3.8-27B%22 and it kept on delivering, and I thought finally the time has come where I no longer need a cloud AI subscription. Then came Qwen 3.8 Flash Next and oh boy, my mind was blown again. It was a bit better than 27b in terms of quality, but the biggest improvement was overall speed. It was still slow on prefill and had more or less similar decode tok/sec, but it took less time overall to finish tasks as it didn't spend as much time as 27b thinking. Here is a real world sample https://github.com/llamastash/llamastash/pull/75 . The numbers make the point better than the feeling does. Flash Next does not decode faster, it just doesn't overthink as much as 27b. The top two rows are a short greedy prompt, the rest are five coding tasks with the generated code executed against hidden tests. | | Flash Next | 27b ROCmFP4 | |---|---|---| | Decode | 23.7 tok/s | 24.5 tok/s | | Prefill | 96 tok/s | 150 tok/s | | Correctness, 5 tasks | 5/5 | 5/5 | | Tokens spent | 2,320 | 4,223 | | Wall clock | 76.5 s | 289.8 s | Same answers, 45% fewer tokens, 3.8x faster to done, but 27b is the one that is ahead on both raw speed numbers. I would say Flash Next is on par with Opus 4.8 in terms of quality, just from experience so far They have an AA score of 40 and 42 respectively . So thanks again Alibaba and Qwen team. It did need a lot more memory to run on my 128GB Strix Halo https://deepu.tech/my-fully-offline-ai-assisted-linux-development-machine , around 86 GiB resident against 31 GiB for the 27b, so it isn't the only choice yet. I use it for the more complex tasks and the ones that need to get done faster. For everything else 27b is still my go to, because at 31 GiB I can keep two of them loaded at once and switch thinking modes without a restart, and as the chart shows they aren't far apart in quality. I wrote a detailed post about my fully offline AI assisted Linux development machine https://deepu.tech/my-fully-offline-ai-assisted-linux-development-machine . TL;DR; It's an ASUS ROG Flow Z13 with Ryzen AI Max+ 395, 16 cores and 32 threads, AMD Radeon 8060S integrated GPU with 40 compute units and 128GB unified memory. I run Arch Linux on it with Niri + DMS as my desktop. I use my tool LlamaStash https://github.com/llamastash/llamastash to orchestrate the model and manage the sessions. It is a fast TUI, CLI, daemon, and OpenAI-compatible proxy for running local LLMs via backends like llama.cpp https://github.com/ggml-org/llama.cpp and vLLM https://github.com/vllm-project/vllm . It has a lot of features that make it easy to run local models and manage them, like multiple backends, preset files, named launches, auto start etc. I mainly run llama.cpp as backend with different builds for different models. Here is my LlamaStash config for it. backend: llamacpp: llama-server build variants; first entry is the default binary. servers: - binary: /mnt/work/Workspace/llms/llama.cpp/build-hip/bin/llama-server ROCm0 - binary: /mnt/work/Workspace/llms/llama.cpp/build-vulkan/bin/llama-server Vulkan0 Shim, not raw binary: sources q38rocm's setup env.sh RADV PERFTEST, unified memory, ICD pin that llamastash has no env hook for. - binary: /home/deepu/.local/bin/q38rocm-llama-server name: ROCmFP4 ROCm0 + Vulkan0 unslothai fork: only needed to load qwen4exp MTP draft heads, which stock rejects ~1.3x speedup . Drop when MTP support lands upstream. - binary: /mnt/work/Workspace/llms/llamacpp-unsloth/llama-server name: UnslothMTP ROCm0 Fork build for the DFlash2 sidecar drafter; --spec-draft-adaptive was never upstreamed. - binary: /home/deepu/.local/bin/dflash-llama-server name: DFlash2 Vulkan0 ds4: enabled: true servers: - binary: /mnt/work/Workspace/llms/ds4/ds4-server vllm: enabled: true servers: - binary: /home/deepu/.venvs/vllm/bin/vllm lemonade: enabled: true Four llama.cpp builds for one machine looks silly until you need them. Stock ROCm is the default, Vulkan wins decode on the ROCmFP4 fork, and the two named forks exist only because their speculative decoding paths were never upstreamed at the time of writing . A LlamaStash preset can pin which build it wants, so I never have to remember which is which. For coding I mostly use Pi https://pi.dev as harness these days. It pairs well with Qwen models and I have it setup to follow the same rules and memories as my, hopefully getting closer to retire, Claude Code setup. Below is the LlamaStash provider block in ~/.pi/agent/models.json , which llamastash integrations writes for you. { "providers": { "llamastash": { "api": "openai-completions", "apiKey": " llamastash api-key", "baseUrl": "http://127.0.0.1:11435/v1", "name": "LlamaStash", "models": { "id": "Qwen3.8-Flash-Next-UD-Q4 K XL", "name": "Qwen3.8-Flash-Next", "contextWindow": 131072, "maxTokens": 8192 }, { "id": "Qwen3.8-27B-Q8 0", "name": "Qwen3.8-27B-Q8 0", "contextWindow": 131072, "maxTokens": 8192 }, { "id": "Qwen3.8-27B-ROCmFP4-FAST", "name": "Qwen3.8-27B-ROCmFP4-FAST", "contextWindow": 131072, "maxTokens": 8192 }, { "id": "Qwen3.8-27B-UD-Q6 K@xhigh", "name": "Qwen3.8-27B xhigh ", "contextWindow": 131072, "maxTokens": 8192 }, { "id": "Qwen3.8-27B-UD-Q6 K@medium", "name": "Qwen3.8-27B medium ", "contextWindow": 131072, "maxTokens": 8192 } } } } The last two entries are the interesting ones. A