12:40
2026-08-10
dev.to
machine-learning
Distilling Kimi Into Qwen Doesn't Give You Kimi. It Gives You Qwen With Kimi's Handwriting
A Berkeley team's experiments show that distilling a strong model's outputs into an open model transfers reasoning structure, not capability, with accuracy drops of 3.2-3.3 points when traces contain โฆ