{"slug": "reasoning-aware-compression-identifying-and-protecting-vulnerable-reasoning-for", "title": "Reasoning-Aware Compression: Identifying and Protecting Vulnerable Reasoning Circuits for Energy-Efficient LLM Deployment", "summary": "A reasoning-aware compression framework that selectively restores the most quantization-sensitive circuits to FP16 achieves Pareto-optimal energy-accuracy points unreachable by uniform quantization, according to an arXiv paper (arXiv:2609.05512v1). Profiling per-module INT4 vulnerability across all 196-224 (layer, projection) pairs on a held-out calibration split, the authors report that R1-Qwen-7B Top-10% on ProofWriter gains +12 percentage points over FP16 at -9.7% energy, validated across GSM8K, FOLIO, MATH-500, ProofWriter, and MuSiQue. The paper also finds INT4 quantization can raise total energy by lengthening reasoning chains, turning a 25% power reduction into a net energy increase on GSM8K, and that vulnerability is task-dependent, with attention projections more critical for mathematical reasoning.", "body_md": "arXiv:2609.05512v1 Announce Type: new \nAbstract: Large Reasoning Models (LRMs) impose substantial energy costs during deployment, yet current compression methods apply uniform quantization across all components, risking damage to critical reasoning circuits. We present a reasoning-aware compression framework that benchmarks quantization conditions across five reasoning benchmarks, GSM8K, FOLIO, MATH-500, ProofWriter, and MuSiQue, with hardware-level GPU energy measurement; profiles per-module INT4 vulnerability across all 196-224 (layer, projection) pairs via a perturbation sweep on a held-out calibration split, then selectively restores the most sensitive circuits to FP16. Three findings emerge. First, INT4 quantization can increase energy by extending reasoning chains; a 25% power reduction becomes a net energy increase on GSM8K. Second, vulnerability is task-dependent: attention projections are more critical for mathematical reasoning, and sensitivity patterns differ by architecture in logical inference. Third, selective compression achieves Pareto-optimal points inaccessible to uniform methods: R1-Qwen-7B Top-10% on ProofWriter gains +12 pp over FP16 at -9.7% energy, validated on held-out data across five reasoning benchmarks.", "url": "https://wpnews.pro/news/reasoning-aware-compression-identifying-and-protecting-vulnerable-reasoning-for", "canonical_source": "https://arxiv.org/abs/2609.05512", "published_at": "2026-09-10 04:00:00+00:00", "updated_at": "2026-09-10 04:21:16.566910+00:00", "lang": "en", "topics": ["large-language-models", "ai-research", "ai-infrastructure", "machine-learning"], "entities": ["arXiv", "GSM8K", "FOLIO", "MATH-500", "ProofWriter", "MuSiQue", "R1-Qwen-7B"], "alternates": {"html": "https://wpnews.pro/news/reasoning-aware-compression-identifying-and-protecting-vulnerable-reasoning-for", "markdown": "https://wpnews.pro/news/reasoning-aware-compression-identifying-and-protecting-vulnerable-reasoning-for.md", "text": "https://wpnews.pro/news/reasoning-aware-compression-identifying-and-protecting-vulnerable-reasoning-for.txt", "jsonld": "https://wpnews.pro/news/reasoning-aware-compression-identifying-and-protecting-vulnerable-reasoning-for.jsonld"}}