Ling-3.0-Flash

InclusionAI released Ling-3.0-Flash-Sante, a Mixture-of-Experts model built on Ling-3.0-Flash with 124 billion total parameters that activates approximately 5.1 billion parameters per token. The model…

A new system called RoutePack, developed by researchers, improves training throughput for Mixture-of-Experts (MoE) reinforcement learning models by coordinating expert placement and data packing. On L…