12:51
2026-08-17
arxiv.org
machine-learning
Solving Moe Load Imbalance in LLM Training via Optimal Transport
Researchers introduced TAOT, a topology-aware optimal transport method for dynamic expert-replica placement in Mixture-of-Experts (MoE) training, which models load imbalance as an entropy-regularized โฆ