{"slug": "qwen-3-8-flash-via-dwarfstar", "title": "Qwen 3.8 Flash via DwarfStar", "summary": "Salvatore Sanfilippo (antirez) announced that Qwen3.8 Flash Next is now supported in DwarfStar, delivering 50–70 tokens per second inference and over 1400 tokens per second prefill on 64GB Mac systems, Metal-only for now. Sanfilippo credited contributor @ivanfioravanti for the pull request and noted N-grams on SSD as in DS4.1F, adding that the speed could appeal to DGX Spark users with 128GB and that ROCm makes sense for 64GB Framework Desktop owners.", "body_md": "antirez on X: \"Qwen3.8 Flash Next is now supported in DwarfStar, covering 64GB Mac systems very well and with very fast inference of 50~70 t/s and > 1400 t/s prefill. For now this is Metal only. Thanks to @ivanfioravanti for all the cool work in the PR. N-grams on SSD like for DS4.1F.\"\n\nQwen3.8 Flash Next is now supported in DwarfStar, covering 64GB Mac systems very well and with very fast inference of 50~70 t/s and > 1400 t/s prefill. For now this is Metal only. Thanks to @ivanfioravanti for all the cool work in the PR. N-grams on SSD like for DS4.1F.\n\nQwen3.8 Flash Next is now supported in DwarfStar, covering 64GB Mac systems very well and with very fast inference of 50~70 t/s and > 1400 t/s prefill. For now this is Metal only. Thanks to @ivanfioravanti for all the cool work in the PR. N-grams on SSD like for DS4.1F.\n\nNot sure if this makes sense on the DGX Spark. You have 128GB there, however the extra speed could be very tempting for the Spark users, as well as having a lot of RAM free for other stuff. For ROCm it makes sense as many folks have a Framework Desktop with 64GB.", "url": "https://wpnews.pro/news/qwen-3-8-flash-via-dwarfstar", "canonical_source": "https://twitter.com/antirez/status/2099487927793299936", "published_at": "2026-09-14 14:38:09+00:00", "updated_at": "2026-09-14 14:48:31.452269+00:00", "lang": "en", "topics": ["large-language-models", "ai-infrastructure", "ai-tools", "ai-products"], "entities": ["Qwen3.8 Flash Next", "DwarfStar", "Salvatore Sanfilippo", "ivanfioravanti", "Metal", "DGX Spark", "ROCm", "Framework Desktop"], "alternates": {"html": "https://wpnews.pro/news/qwen-3-8-flash-via-dwarfstar", "markdown": "https://wpnews.pro/news/qwen-3-8-flash-via-dwarfstar.md", "text": "https://wpnews.pro/news/qwen-3-8-flash-via-dwarfstar.txt", "jsonld": "https://wpnews.pro/news/qwen-3-8-flash-via-dwarfstar.jsonld"}}