cd /news/large-language-models/zqn-12b-our-second-open-model-plus-t… Β· home β€Ί topics β€Ί large-language-models β€Ί article
[ARTICLE Β· art-169917] src=dev.to β†— pub= topic=large-language-models verified=true sentiment=Β· neutral

ZQN-12B: our second open model, plus the M3-GPTQ compression paper

ZAQERIS Ai, an independent research group in Cairo, released ZQN-12B, its second open model, on Hugging Face along with a technical paper describing its compression method, M3-GPTQ. The paper details a technique combining Block-Hadamard decorrelation, Hessian-salience outlier selection, multi-stage 8-dimensional residual vector quantization, and Block-8 Cholesky GPTQ error propagation for extreme-bitrate LLM compression. The group describes the release as an early checkpoint rather than a frontier model, with its limitations documented on the model card.

by read1 min views3 publishedNov 15, 2026

ZQN-12B is the second open model from ZAQERIS Ai, an independent AI research group in Cairo, Egypt.

Model: https://huggingface.co/ZAQERIS/ZQN-12B Alongside the model we published the technical paper behind its compression: "ZAQERIS M3-GPTQ: Hessian-Aware Multi-Stage Residual Vector Quantization for Extreme Bitrate LLM Compression". It combines Block-Hadamard decorrelation, Hessian-salience outlier selection, multi-stage 8-dimensional residual vector quantization, and Block-8 Cholesky GPTQ error propagation.

Paper: https://huggingface.co/ZAQERIS/ZQN-12B/blob/main/docs/papers/ZAQERIS_M3_GPTQ_PAPER.md This is an early checkpoint, not a frontier model, and we are honest about its limits on the model card. Feedback and contributions are welcome.

── more in #large-language-models 4 stories Β· sorted by recency
── more on @zaqeris ai 3 stories trending now
sponsored brought to you by zahid.host 4,200+ EU-deployed projects
reading about agents? ship yours in a single git push.

Run your AI side-project on zahid.host

EU-based hosting, git-push deploys, automatic HTTPS, no cold starts. Free tier with a custom domain β€” perfect for shipping the agent you just read about.

$git push zahid main
β†’ Live at https://your-agent.zahid.host βœ“
Get free account β†’ Pricing
from €0/mo Β· no card required
LIVE [news/zqn-12b-our-second-o…] indexed:0 read:1min 2026-11-15 Β· β€”