LLM distillation: optimizing what to label
A GitHub project by mpcsb demonstrates that after distilling a large language model's labels into a smaller student model, the next labeling budget should target weak class boundaries identified by student-teacher disagr…