# Nvidia's Nemotron 4 aims for one trillion parameters, a scale Chinese labs already surpassed

> Source: <https://the-decoder.com/nvidias-nemotron-4-aims-for-one-trillion-parameters-a-scale-chinese-labs-already-surpassed/>
> Published: 2026-08-12 12:37:58+00:00

# Nvidia's Nemotron 4 aims for one trillion parameters, a scale Chinese labs already surpassed

**Nvidia is building Nemotron 4, a new open-weight model designed to compete with the best freely available models in the world.** According to [The Information](https://www.theinformation.com/articles/nvidia-open-source-ai), the largest model in the family will have at least one trillion parameters, twice the size of [Nemotron 3 Ultra](https://the-decoder.com/nvidias-nemotron-3-ultra-becomes-the-smartest-open-us-model-but-china-still-leads/). Nvidia has tripled its cloud spending on in-house model training to $28 billion through 2031. The earliest possible release would be this fall.

Even at one trillion parameters, Nvidia would only be reaching a scale that Chinese labs already occupy. Moonshot AI's [Kimi K3](https://the-decoder.com/kimis-open-model-k3-nears-gpt-5-6-sol-and-fable-5-while-signaling-the-end-of-super-cheap-chinese-ai/) has 2.8 trillion parameters, and [DeepSeek V4 Pro](https://the-decoder.com/as-agentic-ai-pushes-rivals-to-raise-prices-and-cap-usage-deepseek-ships-a-good-enough-model-for-almost-nothing/) has 1.6 trillion. At launch in June, Nemotron 3 Ultra was the strongest open US model on the Artificial Analysis Intelligence Index, but still trailed [Kimi K2.6](https://the-decoder.com/open-weight-kimi-k2-6-takes-on-gpt-5-4-and-claude-opus-4-6-with-agent-swarms/). On the current version of the index, Nemotron 3 Ultra scores 38 points and Kimi K3 around 60.

Nvidia is also among the signatories of a [petition against regulating open models](https://the-decoder.com/us-reportedly-favors-selective-bans-over-blanket-restrictions-on-chinese-open-weight-models-citing-security-concerns/), even as the Trump administration considers targeted bans on specific Chinese models. The more companies self-host open models, the more GPUs Nvidia sells. But Nemotron 4 would also put Nvidia in direct competition with its own [major customers like OpenAI](https://the-decoder.com/openai-and-nvidia-announce-10-gigawatt-partnership-for-ai-infrastructure/).

```
AI News Without the Hype – Curated by Humans

					Subscribe to THE DECODER for ad-free reading, a weekly AI newsletter, our exclusive "AI Radar" frontier report six times a year, full archive access, and access to our comment section.				

					Subscribe now
```

[The Information](https://www.theinformation.com/articles/nvidia-trying-develop-worlds-best-open-source-ai-models)
