# ZQN-12B: our second open model, plus the M3-GPTQ compression paper

> Source: <https://dev.to/zaqeris_ai/zqn-12b-our-second-open-model-plus-the-m3-gptq-compression-paper-30o8>
> Published: 2026-11-15 10:44:32+00:00

ZQN-12B is the second open model from ZAQERIS Ai, an independent AI research group in Cairo, Egypt.

Model: [https://huggingface.co/ZAQERIS/ZQN-12B](https://huggingface.co/ZAQERIS/ZQN-12B)

Alongside the model we published the technical paper behind its compression: "ZAQERIS M3-GPTQ: Hessian-Aware Multi-Stage Residual Vector Quantization for Extreme Bitrate LLM Compression". It combines Block-Hadamard decorrelation, Hessian-salience outlier selection, multi-stage 8-dimensional residual vector quantization, and Block-8 Cholesky GPTQ error propagation.

Paper: [https://huggingface.co/ZAQERIS/ZQN-12B/blob/main/docs/papers/ZAQERIS_M3_GPTQ_PAPER.md](https://huggingface.co/ZAQERIS/ZQN-12B/blob/main/docs/papers/ZAQERIS_M3_GPTQ_PAPER.md)

This is an early checkpoint, not a frontier model, and we are honest about its limits on the model card. Feedback and contributions are welcome.