# Choosing Quantized Code LLMs by File Size and Energy per Solved Task

> Source: <https://aiflash.com/news/154518/>
> Published: 2026-11-19 19:32:33+00:00

**Recommendation:** When picking a local code model, measure energy per solved task across quantization levels rather than assuming a larger lower-precision model always wins.
More in the playbook "Inference and self-hosting": <https://wpnews.pro/playbooks/inference-serving>

A developer running a code assistant on a laptop downloads one model file, and local inference moves the energy of every request onto that machine. A common rule says a larger model at lower precision tends to beat a smaller one at higher precision. We ran 24 GGUF files of Qwen2.5-Coder at four size
