22:09
2026-10-04
alphaxiv.org
large-language-models
Generalization Dynamics of LM Pre-Training
A new study of OLMo3 and Apertus pre-training checkpoints finds that language models repeatedly and abruptly switch between pattern-matching and generalizable computation, a behavior the authors call …