04:00
2026-10-12
arxiv.org
large-language-models
Mitigating Capability Degradation in LLM Self-Improvement via Representation Geometry Regularization
A new arXiv paper (2610.12855v1) reports that On-Policy Self-distillation (OPSD) can progressively degrade previously acquired capabilities in large language models, with queries answered correctly at…