{"slug": "ai-is-starting-to-rewrite-the-software-that-made-nvidia-untouchable", "title": "AI is starting to rewrite the software that made Nvidia untouchable", "summary": "Nvidia's CUDA software moat is being challenged as AI coding agents recreate similar software in hours, according to Jeremy Nixon, founder of AI software startup Infinity, whose team built CUDA-like software for chip startup D-Matrix in 10 hours. Cloud giants Google, Amazon, and Microsoft have invested in their own AI chip software, and OpenAI and Anthropic have demonstrated AI models that generate system software, signaling a potential shift in the AI chip landscape.", "body_md": "Nvidia's biggest competitive advantage is no longer as untouchable as it once seemed.\n\nFor two decades, Nvidia's crown jewel wasn't just chips; it was the software that turned them into the building blocks of AI, known as CUDA.\n\nShort for [Compute Unified Device Architecture, CUDA](https://www.businessinsider.com/nvidia-secret-sauce-regulators-gpu-chips-jensen-huang-2024-7) is the brainchild of longtime Nvidia executive [Ian Buck](https://www.businessinsider.com/ian-buck-nvidia-moat-cuda-2025-6), who heads [high-performance computing](https://www.businessinsider.com/nvidia-power-players-leaders-ai-chip-giant-success-2024-7). It took years to build, with ready-made code for common AI tasks, tools to find bugs, and software that lets thousands of chips work together to train models.\n\nNow, some believe AI could eventually automate one of the industry's hardest jobs: building the software that powers AI itself.\n\nThe industry is at an important threshold, says [Jeremy Nixon](https://www.businessinsider.com/the-top-hacker-houses-in-san-francisco-for-2025-2025-4), a former Google Brain researcher and the founder of AI software startup Infinity. He told Business Insider his startup used AI coding agents to recreate CUDA-like software for the [chip startup D-Matrix ](https://www.businessinsider.com/nvidia-gtc-gpu-plans-global-tensions-4-big-questions-2026-3)in 10 hours — evidence, he said, that one of Nvidia's biggest moats is being crossed.\n\nThe pressure doesn't only come from startups. Cloud giants like Google, Amazon, and Microsoft have spent years building software around their own AI chips, while OpenAI and Anthropic have recently demonstrated AI models capable of generating system software.\n\n[DeepSeek founder Liang Wenfeng](https://www.businessinsider.com/who-is-deepseek-founder-liang-wenfeng) recently [said that coding agents](https://www.fredgao.com/p/deepseeks-liang-wenfeng-breaks-his), along with his startup's own programming language TileLang, have made AI software substantially easier to build.\n\nCoding agents aren't just helping challengers.\n\nNvidia said developers increasingly use CUDA's code libraries to build AI applications, and that it also \"uses AI coding agents to develop CUDA faster and validate at greater scale,\" said Ankit Patel, Nvidia's vice president of developer ecosystem.\n\n## Inference could change the CUDA equation\n\nIf CUDA's first advantage was software, the second is everything built on top of it. Millions of lines of code and internal workflows have been developed by companies, creating a powerful lock-in effect that makes switching to alternatives costly and cumbersome.\n\nInternal documents at [Amazon identified CUDA ](https://www.businessinsider.com/amazon-nvidia-aws-ai-chip-dominance-gpu-trainium-inferentia-2024-5)as a major roadblock to adoption of its Trainium and Inferentia AI chips, Business Insider previously reported.\n\nCUDA's age is both an advantage and a constraint, said [Chris Lattner](https://www.businessinsider.com/sifive-vp-chris-lattner-apple-tesla-google-2020-2), cofounder and CEO of [Qualcomm-owned AI software startup Modular](https://www.businessinsider.com/nvidia-ai-chip-gpu-grip-modular-chris-lattner-google-2025-12). Originally built for gaming long before the AI boom, CUDA carries layers of legacy technology, \"like Microsoft Windows trying to fit onto a phone,\" he said.\n\nOthers say AI's shift from training toward inference — where models answer requests and draw conclusions — creates another threat.\n\nWith this evolution, companies care less about maximizing performance with the most powerful chips and more about running AI profitably, said Marshall Choy, chief business officer of Korean AI chip startup Rebellions.\n\nThis could result in greater demand not only for specialized hardware but for software that can run across different chips. If companies can switch between chips without rewriting software, that reduces one of CUDA's biggest lock-ins.\n\n\"That's where the CUDA moat from Nvidia gets broken because CUDA is no longer a factor in the inference side,\" Choy said. \"It's an open source play.\"\n\nNvidia said that its tightly integrated hardware and software offerings have become more valuable as AI models get put to work.\n\n\"As AI shifts toward inference and agentic workloads, the need for deep, full-stack optimization only grows,\" Patel said.\n\nA shift toward specialized chips and software has Wall Street increasingly questioning Nvidia's CUDA advantage, said Luke Lango, chief technology analyst at InvestorPlace. He said [Nvidia's stagnant stock](https://www.businessinsider.com/jensen-huang-market-nvidia-quarter-meeting-2025-11) price over the past year reflects some of these concerns.\n\n## Nvidia's moat isn't disappearing — it's shifting\n\nNot everyone agrees that coding agents are eroding CUDA's edge. Some believe they could ultimately strengthen it instead.\n\nThough agents make it easier to generate software, AI-generated code still has to be verified and optimized, said Bing Xu, founder of AI software startup INT21. He believes CUDA has the deepest ecosystem of verification tools and other features that help coding agents work more efficiently.\n\nAs agents become more common, he said, that ecosystem will become CUDA's next moat.\n\n\"Agents can generate a lot of code in a short time, but verification is the biggest bottleneck,\" said Xu, whose last AI chip software startup, HippoML, was acquired by Nvidia. He left the chipmaker in April to build INT21.\n\nWhile coding agents do make it easier to build chip software, the improvement is incremental, Lattner said.\n\n\"The hype is not complete nonsense, but it is very overblown,\" he said, adding that writing code is only a small part of building software compared to more complex tasks like optimizing it for production — a critical task because software that maximizes a chip's performance reduces the cost of running AI at scale.\n\nChip software is also something of a niche field, often worked on by elite engineers, Lattner said, giving coding agents far fewer examples to learn from than, for instance, app development, where AI has been trained on vast amounts of public code.\n\nAnd while AI may help rivals catch up, Nvidia benefits from the same technological shifts, Xu said. Whether coding agents weaken CUDA depends on whether competitors catch Nvidia faster than it can gain new ground.\n\nThe world's dominant chipmaker is \"not sleeping or keeping still,\" Xu said.", "url": "https://wpnews.pro/news/ai-is-starting-to-rewrite-the-software-that-made-nvidia-untouchable", "canonical_source": "https://www.businessinsider.com/nvidia-cuda-new-threats-ai-coding-agents-2026-8", "published_at": "2026-08-03 09:00:02+00:00", "updated_at": "2026-08-03 09:28:40.366753+00:00", "lang": "en", "topics": ["artificial-intelligence", "ai-chips", "ai-agents", "developer-tools"], "entities": ["Nvidia", "CUDA", "Ian Buck", "Jeremy Nixon", "Infinity", "D-Matrix", "Google", "Amazon"], "alternates": {"html": "https://wpnews.pro/news/ai-is-starting-to-rewrite-the-software-that-made-nvidia-untouchable", "markdown": "https://wpnews.pro/news/ai-is-starting-to-rewrite-the-software-that-made-nvidia-untouchable.md", "text": "https://wpnews.pro/news/ai-is-starting-to-rewrite-the-software-that-made-nvidia-untouchable.txt", "jsonld": "https://wpnews.pro/news/ai-is-starting-to-rewrite-the-software-that-made-nvidia-untouchable.jsonld"}}