Truncate Bad, Upweight Good: BoN-Style Distillation via Rank-Based Classification
Researchers propose TUP (Truncate-bad, Upweight-good Policy), a distillation method that removes low-ranked completions from the support and reweights only the retained upper tail with tunable sharpness, achieving compet…