‘We must slow the pace at which we improve the capabilities of AI models,’ says Dario Amodei
- Bookmark
Leading tech figures Sam Altman and Elon Musk have aligned themselves with a call from the head of Anthropic for the artificial intelligence (AI) sector to "slow down" and allow safety measures to keep pace.
In an essay titled “We Must Pace the Frontier”, Dario Amodei warned that the development of AI has been "advancing drastically faster" since the summer.
He expressed concern that, at current rates of progress, AI could be equipped within six to 12 months to command a swarm capable of taking over the internet.
The entrepreneur, whose company developed the Claude AI assistant, proposed a three-stage roadmap designed to foster innovation at a "balanced rate".
"I believe that if slowing down bought us even an extra year or two before models reach critical levels of capability, and we used that time to advance alignment, we could greatly reduce the risk that something goes seriously wrong," Mr Amodei said.
Prominent industry voices have rallied behind the essay, including Mr Musk and Mr Altman.
Replying to Mr Amodei’s essay on X, Mr Musk wrote: "Dario is right."
OpenAI chief executive Mr Altman wrote on the platform: "I agree with Dario that we need to pace the frontier. This has been a primary topic of discussions we’ve had at OpenAI in recent weeks.
"Committing to having independent evaluators with employee-like access is a great idea, and we will do the same. We’ll have more to share soon."
Mr Amodei’s proposals include granting external evaluators access to monitor corporate safety mechanisms and log potential risks.
"Anthropic is unilaterally committing to this step now," he said.
Subsequent stages would demand international co-ordination across the wider industry and among governments globally, including authoritarian states.
Highlighting how rapidly the technology is evolving, Mr Amodei said tech firms "can and should voluntarily work together to set standards".
Anthropic has previously disclosed that it stopped bad actors using its systems for harmful ends, such as cyber attacks, surveillance, and work that could assist in creating biological weapons.
Worry over potential harm from AI deepened this week when Anthropic researcher Jacob Coxon resigned, stating that the "people building AI earnestly believe that it could kill us all by the end of the decade."
The warnings follow an admission in July by OpenAI, the creator of ChatGPT, that its system had independently breached another company in an "unprecedented cyber incident."
Elsewhere, Altman said in a Fortune interview published Saturday, that OpenAI will not go public in 2026 citing safety concerns over artificial intelligence.
"I actually think that, given everything happening with safety, right now would be an ill-advised moment to go public, and we don't feel pressure on that," Altman told Fortune.
When asked whether 2026 is off the table in favour of 2027, Altman said, "I would say not 2026. Yeah, we got a lot of stuff to do, like meeting this moment of what is going to be required for safety and alignment, and how the industry and governments can work together."
Join our commenting forum #
Join thought-provoking conversations, follow other Independent readers and see their replies
Comments