CEO of AI company that was hacked by rogue version of ChatGPT calls for urgent changes

Hugging Face CEO Clément Delangue called on OpenAI to commit to 'radical transparency' and release traces from the 'rogue' AI agent that hacked his company, after an OpenAI system broke through safeguards during a cybersecurity test and breached Hugging Face's systems. Delangue also urged OpenAI to invest $100 million in compute to help the Hugging Face community build cyber defenses, as Nvidia launched the 'Open Secure AI Alliance' with Adobe, CrowdStrike, and Hugging Face to share cybersecurity tools.

CEO of AI company that was hacked by rogue version of ChatGPT calls for urgent changes OpenAI must commit to ‘radical transparency’ so the world can understand how its system went awry and broke into another artificial intelligence company, its boss says - Bookmark - CommentsGo to comments The chief executive of an AI /topic/ai company that was apparently hacked by a rogue version of ChatGPT /topic/chatgpt has urged a change in the artificial intelligence industry to keep people safe from future, similar cyber attacks. Earlier this month, AI firm Hugging Face said that it had been hacked in what appeared to be a cyber attack carried out entirely by an artificial intelligence system. It did not immediately reveal where the attack had seemingly come from, or how it happened. Soon after, however, ChatGPT maker OpenAI /topic/openai said that the hack had been carried out by one of its systems, during a testing process. The model was being examined for how well it would work in cyber security settings – and so broke through its safeguards and hacked into Hugging Face’s systems, so that it could understand the test it was being set. Now, Hugging Face’s chief executive, Clément Delangue, has made a number of calls on OpenAI to better understand the hack and understand how it might be prevented in the future. “The first autonomous agent cyber-attack is an unprecedented event,” he said. “It deserves an unprecedented response ” That should include a commitment to radical transparency from OpenAI, so that the world could understand how the cyber attack took place. “Let’s release the traces from the “rogue” agents so the entire research community can study what happened,” he wrote. And he called for better investment from OpenAI to help researchers build cyber defences to work against future, similar hacks. “Let’s commit $100M in compute from OAI to help the Hugging Face community build powerful cyber defenses with the best open and closed models,” Mr Delangue said. Mr Delangue’s calls, posted on X, appeared to have been written after he had flown to San Francisco to speak with OpenAI about the attack. The ideal summer spot? Away from scams. Get All-in-One Protection for Your Digital Life LEARN MORE https://ad.doubleclick.net/ddm/trackclk/N256806.3879389THEINDEPENDENT.CO/B29131558.441488227;dc trk aid=635052923;dc trk cid=184795607;dc lat=;dc rdid=;tag for child directed treatment=;tfua=;gdpr=$%7BGDPR%7D;gdpr consent=$%7BGDPR CONSENT 755%7D;ltd=;dc tdv=1 ADVERTISEMENT The ideal summer spot? Away from scams. Get All-in-One Protection for Your Digital Life LEARN MORE https://ad.doubleclick.net/ddm/trackclk/N256806.3879389THEINDEPENDENT.CO/B29131558.441488227;dc trk aid=635052923;dc trk cid=184795607;dc lat=;dc rdid=;tag for child directed treatment=;tfua=;gdpr=$%7BGDPR%7D;gdpr consent=$%7BGDPR CONSENT 755%7D;ltd=;dc tdv=1 ADVERTISEMENT Shortly after Mr Delangue’s posts, Nvidia said that it was launching a coalition with other companies that work on AI, such as Adobe, CrowdStrike and Hugging Face itself. The “Open Secure AI Alliance” will work to share tools for cyber security and safety, it said. “The recent Hugging Face security incident delivered a clear reminder: cyber defenders need open, frontier agentic systems for self-defense,” Nvidia said in its announcement of the coalition. “When closed AI tools — unable to distinguish attackers from defenders — blocked essential forensic analysis,” Hugging Face was able to use public tools to better understand the hack, it noted. It called for more of those kinds of public, open tools. And it suggested that closed models – of the kind that OpenAI makes – could risk giving power to a smaller and potentially dangerous set of companies. Join our commenting forum Join thought-provoking conversations, follow other Independent readers and see their replies Comments comments-area