{"slug": "they-re-gambling-with-our-lives-ai-researcher-quits-after-warning-could-kill-us", "title": "They're Gambling With Our Lives: AI Researcher Quits After Warning Superintelligence Could Kill Us All", "summary": "Jacob Coxon, a 27-year-old AI researcher, resigned from Anthropic after roughly three years of pretraining AI models, warning that AI companies are racing toward self-improving superintelligence and \"gambling with our lives.\" Coxon, who previously worked at OpenAI, said people building advanced AI \"earnestly believe that it could kill us all by the end of the decade,\" and Anthropic alignment researcher Evan Hubinger put the risk at more than 10 percent over the next decade. The resignation follows an open letter signed by nearly 1,400 AI company employees in July calling for stronger government regulation of AI risks.", "body_md": "# They're Gambling With Our Lives: AI Researcher Quits After Warning Superintelligence Could Kill Us All\n\n## Jacob Coxon says AI labs are racing to build systems that could surpass humans\n\nJacob Coxon, a 27-year-old AI researcher, has quit Anthropic after warning that artificial intelligence companies are racing towards self-improving superintelligence despite concerns over whether humans can maintain control, saying the technology could potentially kill humanity.\n\nCoxon, who previously worked at OpenAI, spent about three years pretraining AI models before resigning from Anthropic. In a statement explaining his departure, he accused both companies of pursuing increasingly powerful systems despite concerns among researchers about whether humans can control them.\n\n## AI Researcher Quits Anthropic Over Safety Fears\n\nCoxon said he left because he believes AI companies are competing to reach self-improving superintelligence rather than slowing down to resolve safety problems.\n\n'Neither company is acting responsibly. They are racing straight to self-improving superintelligence and gambling with our lives,' Coxon wrote in his resignation statement.\n\nHe argued that the problem is not simply that AI systems are becoming more capable. His concern is that companies could eventually develop systems capable of substantially improving their own abilities, creating a race in which commercial and strategic pressure outweighs safety considerations.\n\nCoxon also said the warning was not intended as a publicity stunt, arguing that senior researchers and executives genuinely believe advanced AI could pose an existential threat.\n\n## Researcher Warns AI Could Kill Humans\n\nCoxon said people building advanced AI 'earnestly believe that it could kill us all by the end of the decade'.\n\nHis warning refers to a potential future in which [AI systems become significantly more capable than humans](https://www.ibtimes.co.uk/sam-altman-warns-powerful-ai-dystopian-future-1819603) and can contribute to designing or improving increasingly advanced successors. Such systems could potentially operate with less human oversight, raising concerns about whether researchers could maintain control over their behaviour.\n\nThe concept of superintelligence remains theoretical. Coxon's warning is therefore a prediction about a possible future risk, rather than evidence that AI will inevitably cause human extinction.\n\nHowever, he argued that the possibility is serious enough to require intervention before systems reach that level of capability.\n\n## Anthropic Safety Researcher Backs Warning\n\nCoxon's concerns have also been echoed by Evan Hubinger, an Anthropic alignment researcher, who publicly said he believes AI could kill all humans.\n\nHubinger estimated the risk at more than 10 per cent over the next decade and acknowledged that Anthropic does not yet have a plan guaranteeing that an AI system surpassing human capabilities would follow its creators' intentions.\n\nThe comments are significant because Hubinger is an Anthropic alignment researcher rather than an outside critic of the company.\n\nCoxon had previously considered Anthropic more cautious than OpenAI, making his decision to leave the company particularly notable.\n\n## Concerns Grow as Systems Become More Autonomous\n\nCoxon's resignation comes amid broader concerns about the speed of AI development. Nearly 1,400 employees from AI companies signed an open letter in July calling for stronger government regulation and action on AI risks.\n\nOpenAI Chief Scientist Jakub Pachocki has also warned that AI capabilities are advancing faster than researchers' ability to monitor and control them.\n\nFor Coxon, the answer requires more than individual companies making voluntary safety commitments. He has called for [government intervention](https://www.ibtimes.co.uk/anthropic-government-power-block-high-risk-ai-models-1819150) and greater co-ordination between AI developers to slow the race towards systems that could surpass human capabilities.\n\nCoxon's departure highlights his argument that AI development could be moving towards increasingly autonomous systems faster than adequate safeguards can be established.\n\n© Copyright IBTimes 2026. All rights reserved.", "url": "https://wpnews.pro/news/they-re-gambling-with-our-lives-ai-researcher-quits-after-warning-could-kill-us", "canonical_source": "https://www.ibtimes.co.uk/ai-researcher-quits-anthropic-superintelligence-safety-warning-1819758", "published_at": "2026-09-15 10:09:27+00:00", "updated_at": "2026-09-15 10:39:52.137123+00:00", "lang": "en", "topics": ["ai-safety", "ai-policy", "artificial-intelligence"], "entities": ["Jacob Coxon", "Anthropic", "OpenAI", "Evan Hubinger", "Jakub Pachocki"], "alternates": {"html": "https://wpnews.pro/news/they-re-gambling-with-our-lives-ai-researcher-quits-after-warning-could-kill-us", "markdown": "https://wpnews.pro/news/they-re-gambling-with-our-lives-ai-researcher-quits-after-warning-could-kill-us.md", "text": "https://wpnews.pro/news/they-re-gambling-with-our-lives-ai-researcher-quits-after-warning-could-kill-us.txt", "jsonld": "https://wpnews.pro/news/they-re-gambling-with-our-lives-ai-researcher-quits-after-warning-could-kill-us.jsonld"}}