cd /news/large-language-models/nemotron-3-ultra · home topics large-language-models article
[ARTICLE · art-52728] src=tokenstead.ai ↗ pub= topic=large-language-models verified=true sentiment=· neutral

Nemotron 3 Ultra

NVIDIA released Nemotron 3 Ultra, a 550-billion-parameter open-weight MoE model with hybrid Mamba-2 and Transformer architecture, under the Linux Foundation's OpenMDW-1.1 license. The model requires server-class hardware (minimum 8x H200 GPUs) and achieves top scores among US open-weight models, though it trails Kimi K2.6 on hard reasoning and coding benchmarks.

read2 min views1 publishedJul 9, 2026
Nemotron 3 Ultra
Image: Tokenstead (auto-discovered)

MoE premier550B total, 55B active per token (MoE) - NVIDIA's from-scratch hybrid Mamba-2 + Transformer with LatentMoE routing and 5-token Multi-Token Prediction (MTP) speculative decode. 262K default context (up to 1M with env flags); RULER@1M 94.7. Genuinely open-weight under the Linux Foundation's OpenMDW-1.1 license, downloadable on HuggingFace (BF16 + NVFP4 checkpoints). Server-class only: NVIDIA's stated minimum is 8x H200, 16x H100, or 8x B200/GB200 - BF16 weights are ~1.1TB and the NVFP4 checkpoint ~275GB, so it does not fit a single RTX 5090, RTX 6000 Ada, or Mac Studio M3/M4 Ultra. Not workstation-fittable, so cloud-only for nearly everyone despite open weights. Benchmarks are NVIDIA self-reported (MMLU-Pro 86.8, GPQA 87.0, SWE-bench Verified 70.7); independent eval (Artificial Analysis, Intelligence Index 47.7, #9 of 89) calls it the leading US open-weight model but ~6 points behind Kimi K2.6 on hard reasoning and coding. Treat the vendor throughput figures as claims pending community replication.

  • 550.0B
  • 262k
  • other
  • Jun 2026

Scores #

Or run it in the cloud #

Live per-provider pricing, throughput and uptime - refreshed 3 days ago via OpenRouter. Click a column to sort.

| Provider | Type | Input $/M | Output $/M | Cache $/M | Tok/s | Latency | Uptime | Value |

|---|---|---|---|---|---|---|---|---|
| API | 0.50 | 2.20 | - | - | - | - | cheapest |

Default order: throughput among 95%+ uptime providers, then latency; subscriptions last. Sort by any column. Subscription rows show $/mo in the Value column - per-token columns are "-". Affiliate links are marked sponsored / nofollow. Confirm current pricing on the provider's site before committing.

Detailed API pricing page + JSON endpoint →

Inference cost over time #

Data accumulates from the first daily sync - longer ranges populate over time. Prices come from OpenRouter snapshots, not a historical API.

── more in #large-language-models 4 stories · sorted by recency
── more on @nvidia 3 stories trending now
sponsored brought to you by zahid.host 4,200+ EU-deployed projects
reading about agents? ship yours in a single git push.

Run your AI side-project on zahid.host

EU-based hosting, git-push deploys, automatic HTTPS, no cold starts. Free tier with a custom domain — perfect for shipping the agent you just read about.

$git push zahid main
Live at https://your-agent.zahid.host
Get free account → Pricing
from €0/mo · no card required
LIVE [news/nemotron-3-ultra] indexed:0 read:2min 2026-07-09 ·