Informational Antilocality and the Locality Bias in LLMs
A study submitted to arXiv on 27 Aug 2026 found that transformer-based language models (LLMs) achieve comparable cross-entropy loss on k-antilocal languages regardless of antilocality, but converge more slowly on more an…