04:00
2026-10-02
arxiv.org
artificial-intelligence
On the Off-Policy Teacher in On-Policy Distillation
A new arXiv paper (2609.38360v1) proposes Student-COnditioned Updates of the Teacher (SCOUT), a co-training framework that adapts the teacher model to student-generated prefixes in on-policy distillat…