13:56
2026-07-21
arxiv.org
artificial-intelligence
Loop the Loopies
Researchers have introduced the Loopie series, two Mixture-of-Experts models (20B parameters with 2B active and 6B with 0.6B active) that outperform vanilla Transformer baselines trained with the same…