Do Syntax Heads Influence Model Behavior?
A paper submitted to arXiv on 13 Oct 2026 finds that forcing syntax-specialized attention heads in transformer language models to attend to a distractor noun instead of the subject still leaves the model's syntactic pred…