04:00
2026-09-10
arxiv.org
large-language-models
Looped GPT-BERT: Trading Parameters for Computation in Small Language Modeling
Researchers studying Looped GPT-BERT in the BabyLM 2026 Strict-small setting trained a 12.18M-parameter model on a preprocessed 7.48M-word English corpus, using four physical layers for twelve recurre…