04:00
2026-07-13
arxiv.org
machine-learning
Sticky Routing: Training MoE Models for Memory-Efficient Inference
Researchers propose StickyMoE, a training-time method that adds a routing consistency loss to Mixture-of-Experts models, reducing expert switch rates by up to 60% with less than 4% perplexity degradat…