Deriving neural scaling laws from the statistics of natural language
A paper posted to arXiv on 7 Feb 2026 by Francesco Cagnetta claims the first theory that quantitatively predicts data-limited neural scaling exponents for modern LLMs trained on natural language. The theory isolates two …