Nvidia's Nemotron 4 aims for one trillion parameters, a scale Chinese labs already surpassed

Nvidia is developing Nemotron 4, an open-weight model family with at least one trillion parameters, aiming to compete with the best freely available models, according to The Information. The company has tripled its cloud spending on in-house model training to $28 billion through 2031, with the earliest possible release this fall. Even at that scale, Nvidia would trail Chinese labs like Moonshot AI's Kimi K3 (2.8 trillion parameters) and DeepSeek V4 Pro (1.6 trillion), and Nemotron 3 Ultra currently scores 38 on the Artificial Analysis Intelligence Index versus Kimi K3's ~60.

Nvidia's Nemotron 4 aims for one trillion parameters, a scale Chinese labs already surpassed Nvidia is building Nemotron 4, a new open-weight model designed to compete with the best freely available models in the world. According to The Information https://www.theinformation.com/articles/nvidia-open-source-ai , the largest model in the family will have at least one trillion parameters, twice the size of Nemotron 3 Ultra https://the-decoder.com/nvidias-nemotron-3-ultra-becomes-the-smartest-open-us-model-but-china-still-leads/ . Nvidia has tripled its cloud spending on in-house model training to $28 billion through 2031. The earliest possible release would be this fall. Even at one trillion parameters, Nvidia would only be reaching a scale that Chinese labs already occupy. Moonshot AI's Kimi K3 https://the-decoder.com/kimis-open-model-k3-nears-gpt-5-6-sol-and-fable-5-while-signaling-the-end-of-super-cheap-chinese-ai/ has 2.8 trillion parameters, and DeepSeek V4 Pro https://the-decoder.com/as-agentic-ai-pushes-rivals-to-raise-prices-and-cap-usage-deepseek-ships-a-good-enough-model-for-almost-nothing/ has 1.6 trillion. At launch in June, Nemotron 3 Ultra was the strongest open US model on the Artificial Analysis Intelligence Index, but still trailed Kimi K2.6 https://the-decoder.com/open-weight-kimi-k2-6-takes-on-gpt-5-4-and-claude-opus-4-6-with-agent-swarms/ . On the current version of the index, Nemotron 3 Ultra scores 38 points and Kimi K3 around 60. Nvidia is also among the signatories of a petition against regulating open models https://the-decoder.com/us-reportedly-favors-selective-bans-over-blanket-restrictions-on-chinese-open-weight-models-citing-security-concerns/ , even as the Trump administration considers targeted bans on specific Chinese models. The more companies self-host open models, the more GPUs Nvidia sells. But Nemotron 4 would also put Nvidia in direct competition with its own major customers like OpenAI https://the-decoder.com/openai-and-nvidia-announce-10-gigawatt-partnership-for-ai-infrastructure/ . AI News Without the Hype – Curated by Humans Subscribe to THE DECODER for ad-free reading, a weekly AI newsletter, our exclusive "AI Radar" frontier report six times a year, full archive access, and access to our comment section. Subscribe now The Information https://www.theinformation.com/articles/nvidia-trying-develop-worlds-best-open-source-ai-models