StepFun P²-MOPD: Multi-Teacher Distillation With Parameter Priors on Qwen3
StepFun-affiliated researchers published P²-MOPD, a multi-teacher on-policy distillation method that treats each student module as learnable weights plus a weighted sum of frozen expert task vectors, reporting 94.7% aver…