04:00
2026-08-11
machinebrief.com
machine-learning
EasyBalance: Cross-Layer Load Balancing in Distributed MoE Inference
Researchers propose EasyBalance, a cross-layer load balancing strategy for distributed Mixture-of-Experts (MoE) inference that requires no modifications to expert-device mapping, reducing GPU idling b…