04:00
2026-07-21
arxiv.org
machine-learning
Multi-level context Modeling for consistent expert selection in Mixture-of-Experts
Researchers propose Multi-level Context Fusion MOE (MCF-MOE), a framework that improves expert selection consistency in Mixture-of-Experts Transformer models by integrating cross-layer semantic aggreg…