Anthropic official claims there is a 10% chance that AI could kill all humans within a decade

Anthropic alignment-science lead Evan Hubinger stated on X that he personally believes there is a greater than 10% chance AI could kill all humans within the next decade, adding that Anthropic lacks a plan to solve alignment for superintelligence. Former Anthropic researcher Jacob Coxon, who resigned, echoed the fear, saying AI developers earnestly believe the technology could cause human extinction by the end of the decade, and Anthropic scalable-oversight lead Samuel Marks confirmed that more senior employees tend to be more concerned.

Anthropic official claims there is a 10% chance that AI could kill all humans within a decade Three current or former Anthropic employees have raised concerns about AI spiraling out of control - Bookmark Current and former employees of Anthropic /news/uk/politics/anthropic-andy-burnham-ed-davey-prime-minister-commons-b3047294.html , an American AI /arts-entertainment/music/news/muse-band-meta-ai-tool-handle-b3047291.html company founded by former OpenAI leaders, say they believe /tech/anthropic-openai-ai-threat-jacob-coxon-b3047033.html AI could potentially kill all humans within the next 10 years. “We really do earnestly believe AI could kill all humans I personally think it is 10% within the next decade. I believe Anthropic is trying its best, but we do not yet have a plan to solve alignment for superintelligence and are not clearly on track to,” Anthropic alignment-science lead Evan Hubinger wrote Tuesday night on X. His comments came after Anthropic AI researcher Jacob Coxon resigned from the company and took to X to detail his departure. “The people building AI earnestly believe that it could kill us all by the end of the decade,” Coxon stated. “This is not a marketing stunt. If anything, many executives and senior researchers will couch their phrasing in the press to sound sensible - but I hear the same people express fear privately. No other human activity poses this level of danger.” His comments come as AI becomes an increasingly routine part of daily life /tech/ai-health-advice-chatgpt-gallup-poll-b2958353.html for millions of Americans /news/world/americas/artificial-intelligence-ai-workplace-gallup-b2907705.html , while concerns over its potential risks grow. Industry leaders have warned that increasingly powerful AI systems could eventually become difficult or impossible to control /tech/ai-jobs-microsoft-mustafa-suleyman-automation-copilot-chatgpt-b2891475.html . Around 2 a.m. Wednesday, Anthropic scalable-oversight lead Samuel Marks also responded https://x.com/saprmarks/status/2097570226804011302 to Coxon’s post, claiming that he was “ Writing this in a personal capacity, not on behalf of my employer Anthropic .” "AI developers believe their technology could cause human extinction or similarly bad outcomes . This could happen in the next few years. In general, the more senior the employee, the more concerned they are,” Marks wrote. The Independent has contacted Anthropic for comment. OpenAI /topic/openai , a separate but leading AI company, declined to comment on Coxon’s post when contacted by The Independent . However, a spokesperson pointed to several updates the company has published in recent weeks outlining its efforts to improve AI safety and alignment. This story is being updated Join our commenting forum Join thought-provoking conversations, follow other Independent readers and see their replies Comments comments-area