03:30
2026-09-02
aiflash.com
artificial-intelligence
SMELT: Scaling Laws for Compute-Matched MoE Looped Transformers
A new research paper introduces SMELT, a study of scaling laws for compute-matched Mixture-of-Experts (MoE) looped Transformers, finding that looping provides architectural advantages beyond mere FLOP…