05:52
2026-07-14
machinebrief.com
machine-learning
Cracking the Code: Solving Imbalance in Mixture-of-Experts Models
Researchers introduced HCRMap, a framework that addresses expert imbalance in Mixture-of-Experts (MoE) models by managing hot expert replicas, reducing end-to-end latency by up to 43.6% in prefill and…