Moonlight-16B-A3B

AMD released Instella-MoE-16B-A3B, a fully open Mixture-of-Experts language model with 16B total parameters and 2.8B active per token, trained from scratch on Instinct MI300X and MI325X GPUs. The mode…

Researchers propose DraftExpert, an expansion-aware self-speculative decoding framework for expert-offloaded Mixture-of-Experts (MoE) inference on end devices, achieving 1.45x average decode throughpu…