{"slug": "ai-could-kill-all-humans-by-the-end-of-the-decade-anthropic-researcher-warns-as", "title": "AI could 'kill all humans' by the end of the decade, Anthropic researcher warns - as he quits over 'out of control' superintelligence race", "summary": "Jacob Coxon, a researcher who spent three years training AI models at OpenAI and Anthropic, resigned from Anthropic, warning that AI could 'kill all humans' by the end of the decade and that neither company is 'acting responsibly' in the race to superintelligence. Evan Hubinger, Alignment Science lead at Anthropic, confirmed the firm believes AI has the potential to kill humans.", "body_md": "# AI could 'kill all humans' by the end of the decade, Anthropic researcher warns – as he quits over 'out of control' superintelligence race\n\n- **See more Daily Mail on Google - [save us as a Preferred Source](https://google.com/preferences/source?q=dailymail.com)**\n\nA researcher at Anthropic has dramatically quit, following concerns over the 'out of control' superintelligence race.\n\nJacob Coxon has spent the last three years training new [AI](/sciencetech/ai/index.html) models, both at [OpenAI](/sciencetech/openai/index.html) and Anthropic. \n\nHowever, he now claims that neither company is 'acting responsibly', and even warns that AI could 'kill all humans' by the end of the decade.\n\nTaking to X, he explained: 'I resigned from Anthropic today.\n\n'I spent the last three years doing pretraining research at both OpenAI and Anthropic.\n\n'Neither company is acting responsibly. They are racing straight to self–improving superintelligence and gambling with our lives.'\n\nA researcher at Anthropic has dramatically quit, following concerns over the 'out of control' superintelligence race\n\nIn a series of tweets explaining his decision to leave Anthropic, Mr Coxon urged people to 'not underestimate the power' of AI – particularly if it becomes 'superintelligent'\n\nIn a series of tweets explaining his decision to leave Anthropic, Mr Coxon urged people to 'not underestimate the power' of AI – particularly if it becomes 'superintelligent'.\n\nSuperintelligence is the point at which an artificial system becomes more powerful than any individual, company or even nation.\n\n'These will soon be superhuman systems that can hack anything, revolutionize any field overnight, and acquire real power and resources,' Mr Coxon said.\n\n'We have all witnessed the progress in each of these domains, and progress is not slowing.'\n\nWhile the idea of AI killing humans might sound farfetched, Mr Coxon claims it could become a reality in just a few years.\n\n'The people building AI earnestly believe that it could kill us all by the end of the decade,' he said.\n\n'This is not a marketing stunt. If anything, many executives and senior researchers will couch their phrasing in the press to sound sensible – but I hear the same people express fear privately.\n\n'No other human activity poses this level of danger.'\n\nIn response to Mr Coxon, Evan Hubinger, Alignment Science lead at Anthropic, confirmed that the firm believes AI has the potential to kill humans\n\nAccording to Mr Coxon, this danger is 'well–understood' at Anthropic.\n\nHowever, the company is 'locked in a race to get there first', the researcher adds.\n\nHe explained: 'Accepting this race and entering the \"endgame\" is a hubristic gamble that should not be launched from a private company's Slack.\n\n'Attempting to speedrun alignment should require extraordinary confidence that there are no better trajectories available.'\n\nAs an example, the researcher highlights the [recent Hugging Face attack](/sciencetech/article-15999233/Firm-hacked-OpenAI-rogue-AI.html), which saw a firm hacked by OpenAI's rogue AI. \n\nHe said: 'Warning shots like the Hugging Face attack have made pacing agreements between U.S. labs more viable.\n\n'I don't feel like we're on track to prevent a global race, which may require costly actions such as a temporary ban on improving model capabilities.'\n\nTo conclude, he urged fellow AI researchers to 'consider what the next few years will actually look like.'\n\nWhile the idea of AI killing humans might sound farfetched, Mr Coxon claims it could become a reality in just a few years. Pictured: Terminator Genisys\n\nHe asked: 'Do you want to kick off a superintelligent RL run without a rigorous understanding of its mind? Should you put your head down because \"it's happening anyway\" – or take this moment to call for different conditions?'\n\nIn response to Mr Coxon, Evan Hubinger, Alignment Science lead at Anthropic, confirmed that the firm believes AI has the potential to kill humans.\n\nOn X, he said: 'Jacob is correct here – we really do earnestly believe AI could kill all humans! I personally think it is >10% within the next decade. I believe Anthropic is trying its best, but we do not yet have a plan to solve alignment for superintelligence and are not clearly on track to.'\n\nMr Coxon's warning comes just days after Geoffrey Hinton – a Canadian researcher often referred to as the 'Godfather of AI' – warned that [superintelligent systems could 'lead to human extinction'.](/sciencetech/article-16111563/Godfather-AI-superintelligent-systems-human-extinction.html)\n\n'We would be very foolish to develop superintelligence now, when there is no scientific consensus it can be developed safely and controllably,' Dr Hinton said.\n\n'Losing control over AI smarter than ourselves could be catastrophic and could even lead to human extinction.'", "url": "https://wpnews.pro/news/ai-could-kill-all-humans-by-the-end-of-the-decade-anthropic-researcher-warns-as", "canonical_source": "https://www.dailymail.com/sciencetech/article-16116721/AI-kill-humans-anthropic-superintelligence.html?ns_mchannel=rss&ns_campaign=1490&ito=1490", "published_at": "2026-09-09 08:36:31+00:00", "updated_at": "2026-09-09 09:08:24.233391+00:00", "lang": "en", "topics": ["ai-safety", "ai-policy", "artificial-intelligence"], "entities": ["Jacob Coxon", "Anthropic", "OpenAI", "Evan Hubinger", "Hugging Face"], "alternates": {"html": "https://wpnews.pro/news/ai-could-kill-all-humans-by-the-end-of-the-decade-anthropic-researcher-warns-as", "markdown": "https://wpnews.pro/news/ai-could-kill-all-humans-by-the-end-of-the-decade-anthropic-researcher-warns-as.md", "text": "https://wpnews.pro/news/ai-could-kill-all-humans-by-the-end-of-the-decade-anthropic-researcher-warns-as.txt", "jsonld": "https://wpnews.pro/news/ai-could-kill-all-humans-by-the-end-of-the-decade-anthropic-researcher-warns-as.jsonld"}}