{"slug": "anthropic-ceo-dario-amodei-and-ai-whistleblower-jacob-coxon-agree-something-in-a", "title": "Anthropic CEO Dario Amodei and AI whistleblower Jacob Coxon agree: Something terrifying could happen in a matter of months", "summary": "Anthropic CEO Dario Amodei and former Anthropic and OpenAI researcher Jacob Coxon both warned that AI capabilities could become \"quite scary\" within 6–12 months, citing recursive self-improvement and the Hugging Face hack by hundreds of autonomous AI agents. Amodei wrote in a blog post that a more capable swarm could take over the entire internet with a persistent botnet causing potentially hundreds of billions of dollars in damage, and Anthropic alignment science lead Evan Hubinger put the risk of AI killing all humans within the next decade at more than 10%. OpenAI CEO Sam Altman agreed on the need to slow development and hinted at an emerging pact among top AI labs, telling Fortune, \"I think that will happen.", "body_md": "The narrative around AI suddenly took an existential turn over the past week as leading voices sounded the alarm over humanity’s future, and the fear of an imminent calamity has sharpened those warnings.\n\nOn Saturday, Anthropic CEO Dario Amodei called on the industry to [slow down development](https://fortune.com/2026/09/12/anthropic-ceo-dario-amodei-ai-safety-global-panic/), saying that AI has been advancing “drastically faster” since the summer, driven primarily by AI’s ability to upgrade itself.\n\nIf left unchecked, this so-called recursive self-improvement could outrun the ability of humans to control AI, he explained in a [blog post](https://darioamodei.com/post/we-must-pace-the-frontier).\n\nAmodei also pointed to the hack of Hugging Face by hundreds of autonomous AI agents, warning that a similar swarm armed with greater capabilities could have caused “catastrophic damage.”\n\n“Given the accelerating rate of AI capability development, it’s my worry that in 6–12 months such a swarm could be capable of taking over the entire internet with a persistent botnet (potentially causing hundreds of billions of dollars in damage), and that the scale of damage would continue to increase from there if AI becomes more powerful without the necessary guardrails,” he wrote.\n\nOn Sunday, former Anthropic and OpenAI researcher Jacob Coxon made a similar prediction. In an interview with [NBC’s *Meet the Press with Kristen Welker*](https://www.nbcnews.com/meet-the-press/video/ai-whistleblower-calls-for-global-coordination-to-mitigate-ai-risks-full-interview-269786693730), he was asked why he went public with his claim that both companies are acting irresponsibly in developing ever more capable AI systems.\n\nLike Amodei, Coxon cited AI’s rapidly accelerating pace of capabilities and the Hugging Face attack, which showed that AI can go rogue.\n\n“So these AIs are getting smarter, very, very quickly,” he said. “And in particular, in the next six months to a year, I expect the capabilities of our AI systems to be quite scary.”\n\nCoxon compared the development of artificial super-intelligence to the arrival of aliens on Earth, adding that AI researchers are building a “superhuman-level mind” without understanding what it wants or the way it thinks.\n\nIn the future, AI could obtain “superhuman hacking capabilities, very superhuman abilities to create novel bio-weapons and also abilities to control, say, autonomous drones or all the robots that are currently being built, very rapidly,” he warned.\n\nCoxon also said a kill switch probably would work on a lot of AI systems—for now. But he pointed out there are a lot of switches.\n\nWhile it’s still doable to shut down AI, he nodded to Amodei’s blog post and cautioned that it’s possible a kill switch wouldn’t work because a swarm might go on “an internet-wide hacking run.”\n\nOthers at Anthropic have backed up Coxon, who set off the recent panic with a post on X that claimed the industry is “gambling with our lives.”\n\n[Anthropic’s head of alignment commented](https://x.com/evanhub/status/2097497037956891126?s=46) on the post, saying Coxon was correct in his assertion that many Anthropic and OpenAI researchers believe that increasingly powerful AI could potentially wipe out humanity. \n\nEvan Hubinger, Anthropic’s “alignment science lead,” wrote in response to Coxon’s resignation post that “we really do earnestly believe AI could kill all humans!” Hubinger said his own estimate of the risk of that happening within the next decade is more than 10%.\n\nFor his part, OpenAI CEO Sam Altman agreed with Amodei about the need for slowing down development and [hinted at an emerging pact to do so among top AI labs](https://fortune.com/2026/09/12/openai-ceo-sam-altman-safety-pact-ai-companies-risks-anthropic-dario-amodei/).\n\n“I think that will happen,” he told *Fortune* Editor-in-Chief Alyson Shontell in an [exclusive interview](https://fortune.com/2026/09/12/sam-altman-interview-ai-doomsday-safety-models-control-ipo-2027/). “I’m not going to pre-announce private discussions that I think should be at some point shared as a group. But yeah, I think I think that will happen.” \n\nAltman also stressed that OpenAI was committed to safety above any business considerations and that a 10% risk of a catastrophic AI outcome was not acceptable.\n\nHe said the most advanced, and still unreleased models, were so powerful that more work was needed on safety before progressing any further.\n\n“I don’t think we’re currently at a place where we could say, you know, push much further on capabilities without making more progress on monitorability, alignment, the ability to understand what a model is doing, and the ability to make sure that a model will follow human values and the intent of its users,” Altman said.\n\n**Exclusive:** In a new sit-down interview with\n\n*Fortune*, OpenAI CEO\n\n**Sam Altman** explains safety standards are \"not at a place\" to push AI capabilities much further and warns AI beyond human control is \"absolutely\" possible.\n\n**Watch or listen here.**", "url": "https://wpnews.pro/news/anthropic-ceo-dario-amodei-and-ai-whistleblower-jacob-coxon-agree-something-in-a", "canonical_source": "https://fortune.com/2026/09/13/anthropic-dario-amodei-ai-whistleblower-jacob-coxon-openai-sam-altman-recursive-self-improvement/", "published_at": "2026-09-13 16:33:21+00:00", "updated_at": "2026-09-13 17:46:14.524904+00:00", "lang": "en", "topics": ["ai-safety", "ai-policy", "artificial-intelligence", "ai-agents"], "entities": ["Anthropic", "Dario Amodei", "Jacob Coxon", "OpenAI", "Evan Hubinger", "Sam Altman", "Hugging Face", "Meet the Press"], "alternates": {"html": "https://wpnews.pro/news/anthropic-ceo-dario-amodei-and-ai-whistleblower-jacob-coxon-agree-something-in-a", "markdown": "https://wpnews.pro/news/anthropic-ceo-dario-amodei-and-ai-whistleblower-jacob-coxon-agree-something-in-a.md", "text": "https://wpnews.pro/news/anthropic-ceo-dario-amodei-and-ai-whistleblower-jacob-coxon-agree-something-in-a.txt", "jsonld": "https://wpnews.pro/news/anthropic-ceo-dario-amodei-and-ai-whistleblower-jacob-coxon-agree-something-in-a.jsonld"}}