NVIDIA Releases Nemotron-Labs-3-Puzzle-75B-A9B: A Compressed Hybrid MoE LLM Delivering 2.03x Server Throughput at Matched User Throughput
NVIDIA released Nemotron-Labs-3-Puzzle-75B-A9B, a compressed hybrid MoE LLM that achieves 2.03x server throughput over Nemotron-3-Super at matched user throughput. The model uses iterative puzzle compression to reduce pa…