Calibrating Teacher--Student Discrepancy for On-Policy Distillation
A new research paper addresses on-policy distillation (OPD), a method for improving reasoning models by learning the token-level discrepancy between a stronger teacher model and an on-policy student model. The work argue…