{"slug": "qwythos-27b-v1-the-long-awaited-27b", "title": "Qwythos-27B-v1: the long-awaited 27B", "summary": "Empero released Qwythos-27B-v1, an open-weights reasoning model under Apache-2.0, built on Qwen3.5-27B with native multi-token prediction, full vision, and a 1,048,576-token context via YaRN. The 27B model retains all base capabilities without ablation, achieving a perplexity drop from 356.6 to 2.76 on held-out terminal/tool sessions, and is available in GGUF quantizations starting at 16.95 GB for a 24GB card.", "body_md": "# Qwythos-27B-v1: the long-awaited 27B\n\nWe just shipped **Qwythos-27B-v1** the long-awaited bigger sibling to Qwythos-9B, now on a Qwen3.5-27B base. It is an open-weights bf16 reasoning model, released under Apache-2.0, with weights and purpose-built GGUFs up now. People have been asking for the 27B since the 9B landed. This is it.\n\nQwythos-27B-v1 is the bigger Qwythos, from the same curriculum family as the 9B and sized up on **Qwen3.5-27B**. The base is dense and hybrid-attention: Gated-DeltaNet linear attention, with a full-attention layer every fourth layer. There are 64 layers, a hidden size of 5120, 24 attention heads, 4 KV heads, and a 248,320-token vocabulary.\n\nIt also keeps Qwen3.5's native function-calling specification. Pass `tools=[...]`\n\nand it works without a wrapper. That matters to us: a reasoning model should be able to use real tools when the answer needs checking, rather than make a performance out of remembering.\n\nThe weights are Apache-2.0. The model is developed by Empero, and the repositories are [Qwythos-27B-v1](https://huggingface.co/empero-ai/Qwythos-27B-v1) and [Qwythos-27B-v1-GGUF](https://huggingface.co/empero-ai/Qwythos-27B-v1-GGUF).\n\n### Nothing was ablated\n\nThis is the spine of the release. At 27B, community fine-tunes often lose at least one of the useful parts of the base. We did not want a larger model that had quietly become less capable at the edges. Qwythos-27B keeps all three intact and active.\n\n**Native MTP.** The native multi-token-prediction head is present with `nextn_predict_layers=1`\n\n. Runtimes that support it can use the model for self-speculative decoding. The GGUF release includes MTP-enabled variants for exactly this reason.\n\n**Full vision.** Image input works, and we ship the `mmproj`\n\n. This is the full vision tower, not a text-only substitute described as multimodal after the fact.\n\n**A real 1M context configuration.** Qwythos uses YaRN at 4x over the 262,144-token native window, for **1,048,576 tokens**. One million tokens sounds like a line item until you are working through a long tool trajectory, a pile of documents, or a codebase that should fit in one prompt. Then it is simply room to keep the thread intact.\n\n### What the size-up buys\n\nThere is a small closed-book example that makes the difference more concrete than a capability adjective. On an organophosphate-poisoning prompt, the 27B volunteered: “avoid physostigmine (it can worsen toxicity).” It also gave correct atropine/pralidoxime dosing, without tools. In the corresponding 9B evaluation, that same fact required a web search to get right.\n\nThat is not a case for skipping verification in clinical use. It is a useful illustration of what the larger model can retain without reaching for a tool, and why the 27B is more than the 9B with a larger number on the label.\n\nWe also measured target-format acquisition on held-out terminal/tool sessions. Perplexity against the base moved from **356.6 to 2.76**. This is not a standardized academic benchmark and we are not treating it like one. It is, however, directly relevant to the kind of long-form terminal and tool work we want the model to handle.\n\nOne more honest note: standardized MMLU and GSM8K benchmarks have **not** been run on this checkpoint. We are not borrowing the 9B's numbers, and there is no benchmark table here. The useful claims for this release are the claims we have measured.\n\n### Running it\n\nFor local use, start with the GGUF release. `Q4_K_M`\n\nis **16.95 GB** and runs on a **24GB card**. There are 11 files in total: Q4_K_M, Q5_K_M, Q6_K, Q8_0, and BF16, each in trunk-only and MTP-enabled variants, plus `mmproj-Qwythos-27B-F16.gguf`\n\n. We ship SHA256SUMS too.\n\n| If you need | Start here |\n|---|---|\n| A 24GB card | `Q4_K_M` (16.95 GB) |\n| Self-speculative decoding in llama.cpp | An MTP-enabled variant with `--spec-type draft-mtp` |\n| Image input | The shipped `mmproj-Qwythos-27B-F16.gguf` |\n\nThere is one non-default choice in these quantizations that is worth being explicit about. In every K-quant, the whole Gated-DeltaNet state path — `ssm_alpha`\n\n, `ssm_beta`\n\n, and `ssm_out`\n\n— remains at **Q8_0 or better**. Those state tensors are disproportionately sensitive to being pushed into Q4, Q5, or Q6; a naive conversion degrades quality there. Holding them higher costs about 2–4% in file size. We think it is the correct trade.\n\nFor long-context serving with vLLM:\n\n```\nVLLM_ALLOW_LONG_MAX_MODEL_LEN=1 vllm serve empero-ai/Qwythos-27B-v1 \\\n  --max-model-len 1010000\n```\n\nQwythos is a reasoning model, so give it room. Our starting settings are `temperature=0.6`\n\nfor agentic or tool use, or `1.0`\n\nfor open-ended and creative work; `top_p=0.95`\n\n; `top_k=20`\n\n; `repetition_penalty=1.05`\n\n; and `max_new_tokens=16384`\n\nor more.\n\nThe one throughput number we are publishing is deliberately narrow: Q4_K_M, fully offloaded to a single RTX 5090 with 32 GB, at 4k context in llama.cpp CUDA, generated **74 tok/s** and processed prompts at **622 tok/s**. One card, one data point, not a benchmark sweep.\n\n### Uncensored on purpose\n\nQwythos is intentionally uncensored for technical and research work. It engages seriously with cybersecurity, biomedical, and technical questions where over-aligned models often refuse or hedge. That is a deliberate choice for researchers, not a claim that deployment needs no thought. If you put it in front of end users, add your own review layer.\n\n### v1, before RL\n\nThis is **v1**, the checkpoint before reinforcement learning. We are releasing it as a complete and usable model, not as a teaser for a future one. An RL-trained v2 follows soon.\n\nIf you build with it, we want to hear what holds up and what does not. The weights and GGUFs are live now; the Empero newsletter at [empero.org](https://empero.org) is where the next release notes will land.\n\n— kodee", "url": "https://wpnews.pro/news/qwythos-27b-v1-the-long-awaited-27b", "canonical_source": "https://empero.org/writing/qwythos-27b-the-long-awaited-27b", "published_at": "2026-07-29 19:27:54+00:00", "updated_at": "2026-07-29 19:59:01.433671+00:00", "lang": "en", "topics": ["artificial-intelligence", "large-language-models", "ai-products", "ai-tools", "ai-research"], "entities": ["Empero", "Qwythos-27B-v1", "Qwen3.5-27B", "Apache-2.0", "Hugging Face", "Qwythos-9B", "YaRN", "GGUF"], "alternates": {"html": "https://wpnews.pro/news/qwythos-27b-v1-the-long-awaited-27b", "markdown": "https://wpnews.pro/news/qwythos-27b-v1-the-long-awaited-27b.md", "text": "https://wpnews.pro/news/qwythos-27b-v1-the-long-awaited-27b.txt", "jsonld": "https://wpnews.pro/news/qwythos-27b-v1-the-long-awaited-27b.jsonld"}}