An artificial intelligence researcher has resigned from Anthropic and called on other staffers to rethink their work, citing his concern that the company and its top competitor OpenAI are acting irresponsibly in their all-out pursuit of a technology that poses existential risks to humanity.
Jacob Coxon, who said he had worked at both Anthropic and OpenAI over the past three years, warned in a social media post late Tuesday that the two companies were pressing ahead with “self-improving” AI models that could become too powerful for humans to control.
“They are racing straight to self-improving superintelligence and gambling with our lives,” Coxon wrote in a series of messages on X. “Do not underestimate the power of this technology. These will soon be superhuman systems that can hack anything, revolutionize any field overnight, and acquire real power and resources.”