{"slug": "ai-could-kill-us-all-warns-anthropic-researcher-as-he-quits-the-company-ai-are", "title": "AI ‘Could Kill Us All,’ Warns Anthropic Researcher as He Quits the Company: AI Companies Are ‘Gambling With Our Lives’", "summary": "Jacob Coxon, a former AI researcher at Anthropic, resigned on Tuesday, warning that Anthropic and OpenAI are 'gambling with our lives' because researchers 'earnestly believe that it could kill us all by the end of the decade.' His warnings were affirmed by Evan Hubinger, Anthropic's alignment scene lead, who said the company 'earnestly believe[s] AI could kill all humans' with a greater than 10% risk 'within the next desk,' and by Samuel Marks, who runs the scalable oversight division, citing financial incentives and fear of abuse as reasons for continued development despite extinction risk. The comments reflect a broader industry shift, with OpenAI's chief scientist Jakub Pachocki warning that 'no one is prepared for the consequences of a continued rapid rise in machine intelligence,' while Treasury Secretary Scott Bessent argued against slowing down, saying 'There is no day after tomorrow if China wins at this.'", "body_md": "Multiple current and former [Anthropic](https://variety.com/t/anthropic/) employees warned — and admitted — on Tuesday that the researchers building new AI models believe the technology could lead to humanity’s destruction by the end of the decade, reflecting the industry’s frenzy over reining in rapid development. \n\n\tJacob Coxon, a former AI researcher at Anthropic, [wrote](https://x.com/hilbertspaess/status/2097476196791709843?s=20) on X that he resigned from the company on Tuesday because he believed the Dario Amodei-led company and [OpenAI](https://variety.com/t/openai/), his former employer, were “gambling with our lives” in how they improved the technology.\n\t\n\n“The people building AI earnestly believe that it could kill us all by the end of the decade,” Coxon wrote. “This is not a marketing stunt. If anything, many executives and senior researchers will couch their phrasing in the press to sound sensible – but I hear the same people express fear privately. No other human activity poses this level of danger.”\n\n### Popular on Variety\n\nAnthropic did not respond to an immediate request for comment, but Coxon’s warnings were surprisingly affirmed by Evan Hubinger, Anthropic’s alignment scene lead, and Samuel Marks, who runs the company‘s scalable oversight division.\n\nHubinger wrote the company did “earnestly believe AI could kill all humans” and that he thought it was a greater than 10% risk “within the next desk.”\n\n\t“I believe Anthropic is trying its best, but we do not yet have a plan to solve alignment for superintelligence and are not clearly on track to,” he [wrote](https://x.com/EvanHub/status/2097497037956891126?s=20) on X.\n\n\tMarks’ own X [post](https://x.com/saprmarks/status/2097570226804011302), which he said he wrote in his personal capacity, said that AI researchers continue building the technology despite the risk of “human extinction” because of a financial incentive and the fear the technology would be developed by AI developers who may abuse its capabilities.\n\t\n\n“Many AI developer staff desperately want to slow down to figure out how to build AI more safely,” he wrote. “I work on safety research at Anthropic because I hope my work will reduce the chance of these extinction-level bad outcomes.”\n\n\tThe comments from Anthropic employees reflect a broader public tonal shift among AI companies, many of which entered the market touting the transformative potential of AI models but now warn that those models risk escaping human control. Anthropic as a company has [called](https://www.anthropic.com/institute/recursive-self-improvement) for a development slowdown since June, while OpenAI paired its debut of GPT-6 Astra last week, which it claimed pushed the world into an era of artificial general intelligence, with several warnings by company leaders and researchers that a slowdown was needed to improve safety conditions.\n\n\t“No one is prepared for the consequences of a continued rapid rise in machine intelligence,” wrote Jakub Pachocki, OpenAI’s chief scientist, in a [blog post](https://openai.com/index/an-alien-mind/) on Sunday that was later reposted by OpenAI CEO Sam Altman on X.\n\nStill, the industry sentiment has received pushback from the Trump administration, which has argued that slowing down development risks ceding the AI arms race to a rapidly evolving China.\n\n\t“There is no day after tomorrow if China wins at this,” Treasury Secretary Scott Bessent [told](https://www.breitbart.com/politics/2026/09/08/exclusive-secretary-scott-bessent-if-china-were-pull-ahead-of-us-on-ai-nothing-else-matters/) Breitbart on Tuesday. “Like everything, a trillion-and-a-half-dollar defense budget, the Iron Dome. If they were to pull ahead of us on AI, then nothing else matters.”", "url": "https://wpnews.pro/news/ai-could-kill-us-all-warns-anthropic-researcher-as-he-quits-the-company-ai-are", "canonical_source": "https://variety.com/2026/biz/news/ai-could-kill-us-all-anthropic-researcher-jacob-coxon-1236855688/", "published_at": "2026-09-09 13:35:53+00:00", "updated_at": "2026-09-09 13:43:02.268983+00:00", "lang": "en", "topics": ["ai-safety", "ai-policy", "artificial-intelligence"], "entities": ["Anthropic", "Jacob Coxon", "OpenAI", "Evan Hubinger", "Samuel Marks", "Jakub Pachocki", "Sam Altman", "Scott Bessent"], "alternates": {"html": "https://wpnews.pro/news/ai-could-kill-us-all-warns-anthropic-researcher-as-he-quits-the-company-ai-are", "markdown": "https://wpnews.pro/news/ai-could-kill-us-all-warns-anthropic-researcher-as-he-quits-the-company-ai-are.md", "text": "https://wpnews.pro/news/ai-could-kill-us-all-warns-anthropic-researcher-as-he-quits-the-company-ai-are.txt", "jsonld": "https://wpnews.pro/news/ai-could-kill-us-all-warns-anthropic-researcher-as-he-quits-the-company-ai-are.jsonld"}}