ExFold: Unified Expert Folding for Training-Free MoE Prefill-Decode Acceleration
Researchers propose ExFold, a training-free expert-folding framework that accelerates both prefill and decode phases of Mixture-of-Experts (MoE) inference by projecting excluded expert contributions onto retained experts…