{"slug": "qwengpu-a-functioning-deterministic-simt-gpu-inside-qwen3-5", "title": "QwenGPU: A functioning, deterministic SIMT GPU inside Qwen3.5", "summary": "A project called QwenGPU has embedded a functioning, deterministic SIMT GPU inside the weights of Qwen3.5-2B, adding 45 compiled layers in front of Qwen's own and using the model's Gated DeltaNet layers as registers and memory. The system runs real CUDA in its forward passes: the host compiles the kernel to PTX and loads it, after which the model writes every step of the launch itself, including every register, branch and memory write. The GPU has 4-lane warps, a 4-stage pipeline, 15 registers per lane and 126 words of global memory held in DeltaNet state, with Qwen generating each launch token by token and each record running one machine block for one warp.", "body_md": "Meet qwenGPU: Qwen3.5-2B with a SIMT GPU inside its weights, 45 compiled layers in front of Qwen’s own, using its Gated DeltaNet layers as registers and memory.\nIt runs real CUDA in its forward passes. The host compiles the kernel to PTX and loads it, then the model writes every step of the launch itself: every register, branch and memory write.\nThe GPU has 4-lane warps, a 4-stage pipeline, 15 registers per lane and 126 words of global memory, all held in DeltaNet state. Qwen generates each launch token by token, each record running one machine block for one warp.", "url": "https://wpnews.pro/news/qwengpu-a-functioning-deterministic-simt-gpu-inside-qwen3-5", "canonical_source": "https://twitter.com/TheVixhal/status/2116938733815738516", "published_at": "2026-11-02 16:45:27+00:00", "updated_at": "2026-11-02 16:51:49.159572+00:00", "lang": "en", "topics": ["artificial-intelligence", "large-language-models", "ai-research", "neural-networks"], "entities": ["QwenGPU", "Qwen3.5-2B", "Qwen", "Gated DeltaNet", "CUDA", "PTX"], "also_reported_by": [], "alternates": {"html": "https://wpnews.pro/news/qwengpu-a-functioning-deterministic-simt-gpu-inside-qwen3-5", "markdown": "https://wpnews.pro/news/qwengpu-a-functioning-deterministic-simt-gpu-inside-qwen3-5.md", "text": "https://wpnews.pro/news/qwengpu-a-functioning-deterministic-simt-gpu-inside-qwen3-5.txt", "jsonld": "https://wpnews.pro/news/qwengpu-a-functioning-deterministic-simt-gpu-inside-qwen3-5.jsonld"}}