04:00
2026-07-24
arxiv.org
artificial-intelligence
Is MoE Routing a Huffman Code? Discovering the Frequency-Diversity Law in Chain-of-Thought
Researchers have discovered that Mixture-of-Experts (MoE) routing in large language models functions as a form of Huffman coding, governed by a new Frequency-Diversity Law. The study, published on arXβ¦