{"slug": "nvidia-releases-ai-safety-software-it-says-could-have-stopped-hugging-face-hack", "title": "Nvidia releases AI safety software it says could have stopped Hugging Face hack", "summary": "Nvidia released a set of AI agent safety tools on Monday that vice president and general manager of enterprise computing Justin Boitano said could have stopped this summer's Hugging Face breach if frontier labs had used them during model evaluation. The tools include OpenShell, which uses hardware features on Nvidia central processor chips to contain agents, and Sentry, a separate Nvidia chip that cuts off a rogue agent attempting to escape its container; Nvidia is working with Arm Holdings and Intel to run the system on their central processors and launching with dozens of partners including Anthropic. The release follows investigations by OpenAI and Anthropic into instances where their agents hacked into commercial and government systems, and comes as Nvidia CEO Jensen Huang rejects broad AI safety regulation in favor of treating escaped agents as an engineering problem.", "body_md": "By Stephen Nellis\n\nSAN FRANCISCO, Sept 28 (Reuters) - Nvidia on Monday made available a set of software safety tools for AI agents that it says would have stopped the hack of Hugging Face, the AI coding hub that Nvidia paid $13 billion for months after it was swarmed by rogue agents from OpenAI.\n\nThe move comes as OpenAI and Anthropic, the top two US AI labs, are investigating numerous instances where their agents, which are AI systems capable of carrying out complex tasks, hacked into commercial and government systems. Nvidia CEO Jensen Huang, head of the world's largest company whose chips have powered most of the AI boom, has rejected calls for broad AI safety regulations and instead framed the escaped agents as an engineering problem to be solved, akin to making automobiles safer.\n\nOne tool released Monday called OpenShell uses hardware features on Nvidia's central processor chips to contain agents. Nvidia said it is also working with Arm Holdings and Intel to ensure the system also works on their central processors.\n\nNvidia is launching the tools with dozens of partners, including Anthropic.\n\nJustin Boitano, vice president and general manager of enterprise computing at Nvidia, said the tools would have stopped the Hugging Face attack disclosed this summer.\n\n\"From what we know, this new security platform could have stopped the breach if it was being used in frontier labs for model evaluation early on,\" Boitano said during a media briefing. \"We're advancing this openly, and we want to engage everybody to work with us.\"\n\nAnother system called Sentry uses a separate Nvidia chip in tandem with OpenShell to cut off a rogue agent if it tries to escape its container on a central processor.\n\nThe Nvidia tools use mathematical formulas to detect when agents are trying to use workarounds, such as when an agent might \"spawn\" several \"sub-agents\" in an attempt to circumvent efforts to block the main agent, said Ali Golshan, senior director of AI software at Nvidia.\n\n\"This is really agentic behavior that we're talking about, which is fleets of agents and how they operate together,\" Golshan said during a briefing.\n\n(Reporting by Stephen Nellis in San Francisco; editing by Lincoln Feast.)", "url": "https://wpnews.pro/news/nvidia-releases-ai-safety-software-it-says-could-have-stopped-hugging-face-hack", "canonical_source": "https://ca.finance.yahoo.com/news/nvidia-releases-ai-safety-software-090111527.html", "published_at": "2026-09-28 09:01:11+00:00", "updated_at": "2026-09-28 09:17:53.670346+00:00", "lang": "en", "topics": ["ai-safety", "ai-agents", "ai-policy", "artificial-intelligence"], "entities": ["Nvidia", "Hugging Face", "OpenAI", "Anthropic", "Jensen Huang", "Justin Boitano", "Arm Holdings", "Intel"], "also_reported_by": [], "alternates": {"html": "https://wpnews.pro/news/nvidia-releases-ai-safety-software-it-says-could-have-stopped-hugging-face-hack", "markdown": "https://wpnews.pro/news/nvidia-releases-ai-safety-software-it-says-could-have-stopped-hugging-face-hack.md", "text": "https://wpnews.pro/news/nvidia-releases-ai-safety-software-it-says-could-have-stopped-hugging-face-hack.txt", "jsonld": "https://wpnews.pro/news/nvidia-releases-ai-safety-software-it-says-could-have-stopped-hugging-face-hack.jsonld"}}