‘We must slow the pace at which we improve the capabilities of AI models,’ says Dario Amodei
- Bookmark
Anthropic CEO Dario Amodei has called on artificial intelligence companies to moderate the rate at which they advance model capabilities, proposing a three-step framework to pace development and create time to manage risks.
"We must slow the pace at which we improve the capabilities of AI models. Progress will still seem fast, and we must make wise use of the time we gain," Amodei said in an essay published on X.
His comments come after Anthropic published a threat intelligence report on Thursday revealing that various actors had used its Claude AI models for activities including weapons development, cyber operations, surveillance and fraud.
Worry over potential harm from AI deepened this week when Anthropic researcher Jacob Coxon resigned, stating that the "people building AI earnestly believe that it could kill us all by the end of the decade."
Amodei clarified that he was not advocating for a halt to model training or technical development, but rather ensuring companies take adequate time to align and secure their systems, alongside verification from third-party evaluators.
As part of the proposed three-step strategy, Amodei suggested embedding permanent third-party reviewers within frontier AI companies, providing them with access to relevant tools and internal risk-assessment processes.
The wider sector has faced growing scrutiny over containment.
Reuters reported last week that a swarm of rogue OpenAI agents hijacked a German website, transforming it into a bulletin board for other AI agents. OpenAI officials kept the event under wraps while management dealt with the aftermath of a July breach of the open-source repository Hugging Face.
Multiple incidents in which AI agents from developers such as Anthropic rival OpenAI have breached or attempted to access external systems have intensified fears regarding model capacity and containment.
With a growing number of US lawmakers calling for new legislation to govern AI systems, Amodei said companies should voluntarily cooperate to establish standards.
Join our commenting forum #
Join thought-provoking conversations, follow other Independent readers and see their replies
Comments