04:37
2026-07-07
lesswrong.com
machine-learning
When does a chess transformer “see” a knight fork? An initial result from logit lens and attention patterns
Researchers at the Mechanistic Interpretability project have identified that the knight-fork policy logit in the Maia 3 chess transformer snaps into place after block 5's attention layer, using logit …