04:00
2026-09-07
arxiv.org
artificial-intelligence
When Load-Balancing Goes Too Far: Expert Pruning in Over-Dispersed Mixture-of-Experts Models
A new arXiv preprint (arXiv:2609.04453v1) finds that expert pruning in Mixture-of-Experts (MoE) models fails under over-dispersed routing, where aggressive load-balancing makes router probabilities un…