18:50
2026-07-13
twitter.com
artificial-intelligence
A brief history of distillation in AI
Distillation has become a hot topic in AI post-training, as highlighted in a recent article by Sergio Paniego that traces the technique's history ahead of a class on distilling open models with TRL. T…