Representation of syntax in LLMs through the lens of linear distance and similarity-aware entropy
A new study on arXiv (2608.27813v1) finds that the accuracy of syntactic tree reconstruction from neural language model representations varies by syntactic relation, and that most of this variability is predicted by the …