MOPD

Researchers propose Multi-teacher On-Policy Distillation (MOPD), a post-training paradigm that combines the capabilities of multiple domain-specific reinforcement learning teachers into a single large…

NVIDIA released Nemotron 3 Ultra, a 550B-parameter hybrid Mamba-Transformer model with 55B active parameters, achieving up to 6x higher inference throughput than state-of-the-art LLMs while maintainin…