{"slug": "zqn-12b-our-second-open-model-plus-the-m3-gptq-compression-paper", "title": "ZQN-12B: our second open model, plus the M3-GPTQ compression paper", "summary": "ZAQERIS Ai, an independent research group in Cairo, released ZQN-12B, its second open model, on Hugging Face along with a technical paper describing its compression method, M3-GPTQ. The paper details a technique combining Block-Hadamard decorrelation, Hessian-salience outlier selection, multi-stage 8-dimensional residual vector quantization, and Block-8 Cholesky GPTQ error propagation for extreme-bitrate LLM compression. The group describes the release as an early checkpoint rather than a frontier model, with its limitations documented on the model card.", "body_md": "ZQN-12B is the second open model from ZAQERIS Ai, an independent AI research group in Cairo, Egypt.\n\nModel: [https://huggingface.co/ZAQERIS/ZQN-12B](https://huggingface.co/ZAQERIS/ZQN-12B)\n\nAlongside the model we published the technical paper behind its compression: \"ZAQERIS M3-GPTQ: Hessian-Aware Multi-Stage Residual Vector Quantization for Extreme Bitrate LLM Compression\". It combines Block-Hadamard decorrelation, Hessian-salience outlier selection, multi-stage 8-dimensional residual vector quantization, and Block-8 Cholesky GPTQ error propagation.\n\nPaper: [https://huggingface.co/ZAQERIS/ZQN-12B/blob/main/docs/papers/ZAQERIS_M3_GPTQ_PAPER.md](https://huggingface.co/ZAQERIS/ZQN-12B/blob/main/docs/papers/ZAQERIS_M3_GPTQ_PAPER.md)\n\nThis is an early checkpoint, not a frontier model, and we are honest about its limits on the model card. Feedback and contributions are welcome.", "url": "https://wpnews.pro/news/zqn-12b-our-second-open-model-plus-the-m3-gptq-compression-paper", "canonical_source": "https://dev.to/zaqeris_ai/zqn-12b-our-second-open-model-plus-the-m3-gptq-compression-paper-30o8", "published_at": "2026-11-15 10:44:32+00:00", "updated_at": "2026-11-15 10:50:58.789352+00:00", "lang": "en", "topics": ["large-language-models", "machine-learning", "ai-research", "ai-tools"], "entities": ["ZAQERIS Ai", "ZQN-12B", "M3-GPTQ", "Hugging Face", "Cairo"], "also_reported_by": [], "alternates": {"html": "https://wpnews.pro/news/zqn-12b-our-second-open-model-plus-the-m3-gptq-compression-paper", "markdown": "https://wpnews.pro/news/zqn-12b-our-second-open-model-plus-the-m3-gptq-compression-paper.md", "text": "https://wpnews.pro/news/zqn-12b-our-second-open-model-plus-the-m3-gptq-compression-paper.txt", "jsonld": "https://wpnews.pro/news/zqn-12b-our-second-open-model-plus-the-m3-gptq-compression-paper.jsonld"}}