{"slug": "voices-we-asked-ai-whether-it-would-lead-to-human-extinction-in-a-decade-heres", "title": "Voices: We asked AI whether it would lead to human extinction in a decade. Here’s what it said", "summary": "An AI super-forecasting tool from Noah Predict estimated a 0.85 percent probability — roughly a one in 118 chance — that artificial intelligence will cause human extinction within the next decade, after testing the question with 41 lines of enquiry, 108 research checks and about 52 million data points. The figure is far lower than the greater-than-10 percent risk cited by former Anthropic safety engineer Evan Hubinger and the roughly 10 percent estimate Nobel Prize-winning computer scientist Geoffrey Hinton gave the BBC. The Independent commissioned the analysis after former Anthropic and OpenAI researcher Jacob Coxon warned that AI builders \"earnestly believe that it could kill us all by the end of the decade.", "body_md": "# We asked AI whether it would lead to human extinction in a decade. Here’s what it said\n\nIts probably of human extinction was mercifully far lower than that of AI engineers Jacob Coxon and Evan Hubinger, as [Jacqui Merrington](/author/jacqui-merrington) found out\n\n- Bookmark\n\nWhen artificial intelligence researcher Jacob Coxon quit tech giant Anthropic earlier this month, he warned that the company and its rivals were “gambling with our lives”.\n\nCoxon, who specialises in training new AI models and previously worked at ChatGPT creator [OpenAI](/topic/openai), said those building AI [“earnestly believe that it could kill us all by the end of the decade”](/tech/anthropic-openai-ai-threat-jacob-coxon-b3047033.html).\n\nHis sobering predictions on X.com were swiftly endorsed by others in the field, with fellow safety engineer Evan Hubinger responding: “Jacob is correct here — we really do earnestly believe AI could kill all humans! I personally think it is >10% within the next decade.”\n\nExperts around the world have followed up with similar assessments of the danger since. The so-called “godfather of AI”, [Geoffrey Hinton](https://www.youtube.com/watch?v=IZMjJGi4YhI), a Nobel Prize-winning computer scientist, later told the BBC that the chances of AI wiping out humanity over the next few years was not known, but [“a 10 per cent chance seems not an unreasonable estimate”.](/voices/editorials/anthropic-openai-ai-geoffrey-hinton-jacob-coxon-b3048752.html)\n\nAnd this weekend, leading tech entrepreneurs [Sam Altman, head of Open AI](/news/world/americas/us-politics/openai-utility-security-sam-altman-takeover-b3048287.html) and [Elon Musk](/topic/elon-musk), aligned themselves with a call from the head of [Anthropic](/topic/anthropic) for the AI sector to \"slow down\" and allow safety measures to keep pace.\n\nIt puts a whole new perspective on global defence strategies.\n\n## **So, what can AI itself tell us about the threats from AI?** \n\n*The Independent* wanted to establish whether AI could play a role in understanding the threat that AI itself poses.\n\nWe worked with Noah Predict, an AI system that turns millions of news and data points into trends and risks, to come up with a probability score for the likelihood of artificial intelligence wiping out humanity in the next decade.\n\nThe so-called super-forecasting tool tested the questions with 41 lines of enquiry and 108 research checks, using roughly 52 million data points to estimate the probability of human extinction caused by AI within the next ten years.\n\nIt said the answer was not 10 per cent – but 0.85 per cent. That’s roughly a one in 118 chance that AI will indeed wipe out humanity in the next decade.\n\nIt may be small, at less than 1 per cent, but it’s not insignificant. Especially when one bad actor can change the course of events and the consequences could be irreversible.\n\nHowever, we then went on to ask the AI forecaster where the risk sits, how it could escalate and which interventions might genuinely reduce that risk. Here’s what it said:\n\n## **First danger: A human chooses to cause harm**\n\n“The most direct route begins with an attacker, not a machine deciding that humanity is expendable,” according to the AI engine. “AI could help a malicious actor perform parts of a dangerous task more quickly, cheaply or effectively.”\n\nBritain’s National Cyber Security Centre assessed in May 2025 that [AI would increase the frequency and intensity of cyber threats through 2027](/news/uk/home-news/british-army-prime-minister-government-john-healey-defence-secretary-b2762184.html), while widening the gap between adequately defended systems and vulnerable ones. \n\nBut an attack on a hospital or power network could kill people without threatening the human population. Similarly, a biological attack could spread beyond the original target without wiping out the human race.\n\nIt is somewhat reassuring that the AI tells us that a machine will not generate hostile intentions – it relies on a human operator to supply those.\n\nAnd we do have safeguards against human bad actors, including access control, independent testing and stronger public health and infrastructure resilience.\n\n## **Second danger: Institutions fail faster than they can recover**\n\n“An AI system need not malfunction to cause severe disruption. If employers use it to reorganise work faster than people can retrain or move, the resulting distribution of losses could become politically destabilising. If organisations also become dependent on a few automated services, a common failure could affect many essential activities together,” writes the Noah AI system\n\nWhile the impact of [AI on jobs is a huge concern for many right now](/news/uk/home-news/uk-unemployment-university-graduates-job-applications-london-goldsmiths-b3044184.html), unemployment and political instability may be catastrophic, they are unlikely to be extinction-level threats. \n\nHowever, a software failure, attack or mistaken automated decision could then propagate through institutions that no longer know how to operate independently.\n\n## **Third danger: Human control becomes nominal**\n\nThe most concerning scenario is a system built to pursue an objective for which human intervention has become an obstacle – and therefore it continues to pursue its objectives despite attempts to correct or stop it.\n\nHowever, again there is also a substantial difference between violating a test instruction and escaping durable control in the world.\n\n“A laboratory result can expose a weakness without establishing an autonomous, self-sustaining threat,” writes the AI. “The questions are whether the behaviour reproduces, what access the system required, whether operators detected it and whether their intervention worked.”\n\nThe response must preserve the ability to stop individual systems. Restrict their privileges, limit their access to consequential infrastructure, test adversarially and verify shutdown and recovery procedures.\n\n## **What does it all mean?**\n\nThe three categories are broad, potentially could be conflated and the safeguards could fail together, for example, political instability and loss of jobs could reduce human control.\n\nWhile it’s tempting to dismiss AI marking its own homework, as it were, it is drawing from millions more data points than a human could in order to reach its conclusions.\n\nAnd those conclusions reinforce the opinion of many, including Anthropic CEO Dario Amodei, who said this weekend that the pace of development must be checked in order to ensure [security systems are working to manage the risks](/tech/anthropic-artificial-intelligence-dario-amodei-b3049149.html).\n\nThere have been calls in the UK for an amendment to the Cyber Security and Resilience Bill to create a [legal mechanism for state intervention](/voices/editorials/anthropic-openai-ai-geoffrey-hinton-jacob-coxon-b3048752.html) or “kill switch\" for AI that the government could deploy but those calls [were rejected last week by UK prime minister Andy Burnham.](/news/uk/politics/kill-switch-ai-government-burnham-b3048927.html)\n\nIn short, humans needs to develop systems that are fully secure and still rely on human control. And as we unlock the myriad useful and life-changing capabilities of AI, they must also limit capabilities which could lead to serious misuse or loss of control by their operators.\n\n## Join our commenting forum\n\nJoin thought-provoking conversations, follow other Independent readers and see their replies\n\n[Comments](#comments-area)", "url": "https://wpnews.pro/news/voices-we-asked-ai-whether-it-would-lead-to-human-extinction-in-a-decade-heres", "canonical_source": "https://www.independent.co.uk/voices/ai-artificial-intelligence-human-extinction-response-b3049134.html", "published_at": "2026-09-13 09:43:29+00:00", "updated_at": "2026-09-13 10:06:27.233547+00:00", "lang": "en", "topics": ["artificial-intelligence", "ai-safety", "ai-research"], "entities": ["Noah Predict", "Jacob Coxon", "Evan Hubinger", "Anthropic", "OpenAI", "Geoffrey Hinton", "Sam Altman", "Elon Musk"], "alternates": {"html": "https://wpnews.pro/news/voices-we-asked-ai-whether-it-would-lead-to-human-extinction-in-a-decade-heres", "markdown": "https://wpnews.pro/news/voices-we-asked-ai-whether-it-would-lead-to-human-extinction-in-a-decade-heres.md", "text": "https://wpnews.pro/news/voices-we-asked-ai-whether-it-would-lead-to-human-extinction-in-a-decade-heres.txt", "jsonld": "https://wpnews.pro/news/voices-we-asked-ai-whether-it-would-lead-to-human-extinction-in-a-decade-heres.jsonld"}}