03:06
2026-08-10
pub.towardsai.net
machine-learning
What I Learned Studying Whether Fine-Tuning Breaks a Transformer’s “Copy Mechanism”
A researcher investigating whether fine-tuning breaks a transformer's induction head circuit found that a bug in the induction score measurement initially caused the known induction head L1H6 in the a…