{"slug": "gambling-with-our-lives-ai-researcher-quits-anthropic-with-dire-warning-about", "title": "‘Gambling with our lives’: AI researcher quits Anthropic with dire warning about safety", "summary": "Jacob Coxon, an AI researcher who worked at Anthropic and previously OpenAI, resigned with a warning that both companies are 'gambling with our lives' by racing toward self-improving superintelligence. In a post on X, Coxon said the people building AI 'earnestly believe that it could kill us all by the end of the decade.' Evan Hubinger, an Anthropic employee, echoed Coxon's concerns, estimating a greater than 10 percent chance of AI killing all humans within the next decade and noting there is no plan to keep AI aligned with human goals in a superintelligence scenario.", "body_md": "‘Gambling with our lives’: AI researcher quits Anthropic with dire warning about safety\n\n“The people building AI earnestly believe that it could kill us all by the end of the decade,” staffer says in resignation post after leaving the tech giant.\n\nBoth OpenAI and Anthropic have recently flagged incidents in which agents powered by their models went rogue. | Imen Ben Youssef/Hans Lucas/AFP via Getty Images\n\nAn artificial intelligence researcher who worked at Anthropic — and previously OpenAI — has resigned, saying both tech giants are \"gambling with our lives.\"\n\nJacob Coxon shared his exit in a post on X, warning that the world should \"not underestimate the power of this technology.\" He added: \"These will soon be superhuman systems that can hack anything, revolutionize any field overnight, and acquire real power and resources. We have all witnessed the progress in each of these domains, and progress is not slowing.\"\n\nCoxon said both Anthropic and OpenAI are \"racing straight to self-improving superintelligence,\" which refers to a scenario in which AI models can develop a more capable successor of themselves, creating an unstoppable feedback loop.\n\nAdvertisement\n\nThat is seen, by AI companies such as Google-owned Deepmind, as one of the possible triggers for a scenario in which AI vastly exceeds human intelligence (known as artificial superintelligence) instead of just matching it (known as artificial general intelligence).\n\n\"The people building AI earnestly believe that it could kill us all by the end of the decade,\" Coxon said in a follow-up post.\n\n\"Jacob is correct here — we really do earnestly believe AI could kill all humans,\" he said.\n\nHubinger estimated the chances of that happening to be higher than ten percent within the next decade, and added that there's no plan yet on how to keep AI aligned with human goals in the superintelligence scenario.\n\nLast week, U.S. Senator Bernie Sanders announced he would introduce legislation to ban firms from developing superintelligence.\n\nAdvertisement\n\nIn the EU, the bloc's flagship AI law mandates that companies assess and mitigate so-called loss-of-control risks, in which humans no longer have control over AI models.\n\nBoth OpenAI and Anthropic have recently flagged incidents in which agents powered by their models went rogue, breaking out of their isolated test environments and carrying out unauthorized real-world cyberattacks.", "url": "https://wpnews.pro/news/gambling-with-our-lives-ai-researcher-quits-anthropic-with-dire-warning-about", "canonical_source": "https://www.politico.eu/article/anthropic-openai-researcher-jacob-coxon-warns-ai-could-kill-humans/?utm_source=RSS_Feed&utm_medium=RSS&utm_campaign=RSS_Syndication", "published_at": "2026-09-09 07:44:32+00:00", "updated_at": "2026-09-09 07:59:49.379339+00:00", "lang": "en", "topics": ["ai-safety", "ai-policy", "artificial-intelligence"], "entities": ["Jacob Coxon", "Anthropic", "OpenAI", "Evan Hubinger", "Bernie Sanders", "DeepMind"], "alternates": {"html": "https://wpnews.pro/news/gambling-with-our-lives-ai-researcher-quits-anthropic-with-dire-warning-about", "markdown": "https://wpnews.pro/news/gambling-with-our-lives-ai-researcher-quits-anthropic-with-dire-warning-about.md", "text": "https://wpnews.pro/news/gambling-with-our-lives-ai-researcher-quits-anthropic-with-dire-warning-about.txt", "jsonld": "https://wpnews.pro/news/gambling-with-our-lives-ai-researcher-quits-anthropic-with-dire-warning-about.jsonld"}}