Nemotron 3 Ultra

NVIDIA released Nemotron 3 Ultra, a 550-billion-parameter open-weight MoE model with hybrid Mamba-2 and Transformer architecture, under the Linux Foundation's OpenMDW-1.1 license. The model requires server-class hardware (minimum 8x H200 GPUs) and achieves top scores among US open-weight models, though it trails Kimi K2.6 on hard reasoning and coding benchmarks.

Nemotron 3 Ultra MoE premier550B total, 55B active per token MoE - NVIDIA's from-scratch hybrid Mamba-2 + Transformer with LatentMoE routing and 5-token Multi-Token Prediction MTP speculative decode. 262K default context up to 1M with env flags ; RULER@1M 94.7. Genuinely open-weight under the Linux Foundation's OpenMDW-1.1 license, downloadable on HuggingFace BF16 + NVFP4 checkpoints . Server-class only: NVIDIA's stated minimum is 8x H200, 16x H100, or 8x B200/GB200 - BF16 weights are ~1.1TB and the NVFP4 checkpoint ~275GB, so it does not fit a single RTX 5090, RTX 6000 Ada, or Mac Studio M3/M4 Ultra. Not workstation-fittable, so cloud-only for nearly everyone despite open weights. Benchmarks are NVIDIA self-reported MMLU-Pro 86.8, GPQA 87.0, SWE-bench Verified 70.7 ; independent eval Artificial Analysis, Intelligence Index 47.7, 9 of 89 calls it the leading US open-weight model but ~6 points behind Kimi K2.6 on hard reasoning and coding. Treat the vendor throughput figures as claims pending community replication. - 550.0B - 262k - other - Jun 2026 Scores Or run it in the cloud Live per-provider pricing, throughput and uptime - refreshed 3 days ago via OpenRouter. Click a column to sort. | Provider | Type | Input $/M | Output $/M | Cache $/M | Tok/s | Latency | Uptime | Value | |---|---|---|---|---|---|---|---|---| | API | 0.50 | 2.20 | - | - | - | - | cheapest | Default order: throughput among 95%+ uptime providers, then latency; subscriptions last. Sort by any column. Subscription rows show $/mo in the Value column - per-token columns are "-". Affiliate links are marked sponsored / nofollow. Confirm current pricing on the provider's site before committing. Detailed API pricing page + JSON endpoint → /models/nemotron-3-ultra/pricing Inference cost over time Data accumulates from the first daily sync - longer ranges populate over time. Prices come from OpenRouter snapshots, not a historical API.