Researcher who departed AI role over fears of racing into extinction says people are 'begging' for regulation

Jacob Coxon, 27, a pretraining researcher who resigned from Anthropic on Tuesday via a post on X, told Fox News' "Special Report" on Wednesday that AI carries a "greater than 10% chance" of killing all humans within the next decade and that "people are begging for regulation." Anthropic alignment science lead Evan Hubinger agreed on X, writing "I personally think it is >10% within the next decade" and that Anthropic "do[es] not yet have a plan to solve alignment for superintelligence." Coxon said the risk from present models is "minimal" but that recursive self-improvement could arrive as soon as next year, and called for international oversight to prevent an arms race.

The Anthropic researcher who is leaving the company over fears the technology is gambling with human life told Fox News https://www.foxnews.com/media there is hope that we can avoid the chance it could destroy humankind within the next decade. Speaking exclusively Wednesday on " Special Report https://www.foxnews.com/shows/special-report ," Jacob Coxon, 27, said regulation is key. He posted his resignation https://x.com/hilbertspaess/status/2097476196791709843 Tuesday on X, writing that companies are not acting responsibly and that the race toward self-improving superintelligence is "gambling with our lives." Coxon, who said he spent the past three years doing pretraining research at OpenAI and Anthropic, noted that it's not a completely hopeless scenario. ANTHROPIC RESEARCHER SAYS AI HAS OVER 10% CHANCE TO 'KILL ALL HUMANS' WITHIN NEXT DECADE He told Fox News chief political anchor Bret Baier the problem is "eminently solvable." He believes there is "definitely" something the country can do to change the dynamic of the "greater than 10% chance" that AI kills all humans. "It's not like we think this is some impossible thing," Coxon said. "It's just we're racing so fast. We haven't got time to, to solve it correctly. We're not being careful and everyone wants to be careful. I think it's just people are begging for regulation. I think it's just a matter of international somebody stepping in and being able to ensure that we don't race ourselves into extinction. The problem is eminently solvable." Evan Hubinger, alignment science lead at Anthropic, expressed his agreement with Coxon's X post. "Jacob is correct here — we really do earnestly believe AI could kill all humans " he wrote on X. "I personally think it is 10% within the next decade. I believe Anthropic is trying its best, but we do not yet have a plan to solve alignment for superintelligence and are not clearly on track to." "To be clear, as we say in our latest Risk Report, I think the risk from present models is low," Hubinger added. "What I am worried about is superintelligence arising from recursive self-improvement, as we have said is happening faster than we thought." Coxon said he agrees with Hubinger that right now, the threat is "minimal" of artificial intelligence https://www.foxnews.com/category/tech/artificial-intelligence 's actual takeover. "But recursive self-improvement — this AIs making themselves smarter — could happen as soon as next year," he added. "Some people even say six months. So this attitude is shared across the industry, where people essentially are aware that the work they are currently doing, if we don't slow down, could lead to AI takeover by the end of the decade." The technology is being used on the international stage as a "superweapon" in an arms race, Coxon said, calling for the global community to provide oversight. "This is possibly the most dangerous technology that humanity has ever created," he continued. "It's basically out of science fiction. I think we have no other choice but to cooperate internationally because an arms race would be disastrous in a way that no other human activity has been in the past." CLICK HERE TO DOWNLOAD THE FOX NEWS APP Coxon mentioned that a number of technology leaders have publicly expressed the need for a slow-down agreement, but people are not yet taking them seriously. "It's not just a marketing stunt," he said. "These people are deadly serious that they think their industry needs to be regulated as soon as possible." As for AI benefit, Coxon said we are "on the doorstep of tremendous discoveries," but we're running in too quickly, calling for moderation. Baier asked Coxon if the issue could be figured out. "I think definitely. I think if we actually try instead of submitting to the inevitability of a doomed race or a hubristic gamble, then we can solve it," he said. "The problem is not unsolvable." Fox News Digital reached out to Anthropic for comment.