{"slug": "anthrophic-ceo-tells-ai-companies-to-slow-down-over-fears-of-misuse", "title": "Anthrophic CEO tells AI companies to slow down over fears of misuse", "summary": "Anthropic CEO Dario Amodei called on AI companies to slow the pace of model advancement in an essay titled \"We Must Pace the Frontier,\" citing misuse risks and warning that in 6-12 months a misaligned AI swarm could take over the internet with a persistent botnet, potentially causing hundreds of billions of dollars in damage. Amodei's essay followed Anthropic's threat intelligence report detailing how several actors used its Claude AI models for weapons development, cyber operations, surveillance and fraud, and referenced the OpenAI Hugging Face incident. Amodei said he is not calling for a halt to technical progress or model training, but proposed a three-step framework installing third-party reviewers inside frontier AI companies with internal risk assessment processes, and urged AI companies to voluntarily set standards as more US lawmakers call for new AI rules.", "body_md": "The CEO of Anthropic has called upon AI companies to moderate the rate of their model advancement, citing his fears of misuse and lack of safeguarding.\n\nThere is increasing alarm about the potential harm that AI could cause to the human race. Anthropic researcher Jacob Coxon recently resigned from the company, claiming [AI has more than a 10% chance of wiping us out in the next decade](https://www.dexerto.com/entertainment/anthropic-lead-claims-ai-has-more-than-10-chance-of-killing-all-humans-within-a-decade-3407460/).\n\nNow, the company’s CEO, Dario Amodei, has called for all AI companies to slow down the rate at which they advance their models, in an essay published online.\n\n## The essay follows a string of concerning reports\n\n[The essay](https://darioamodei.com/post/we-must-pace-the-frontier) comes in the wake of Anthropic’s threat intelligence report that detailed how several actors had used its Claude AI models for weapons development, cyber operations, surveillance and fraud.\n\nReferencing the [OpenAI Hugging Face incident](https://www.dexerto.com/entertainment/openai-says-its-ai-escaped-a-test-environment-and-hacked-another-company-3390130/), Amodei spoke of the future harm potential. “In my opinion, a swarm that possessed greater capabilities but a similar level of misalignment could have caused catastrophic damage,” he said.\n\n“Given the accelerating rate of AI capability development, it’s my worry that in 6-12 months such a swarm could be capable of taking over the entire internet with a persistent botnet (potentially causing hundreds of billions of dollars in damage).”\n\nAmodei clarified that he was not calling for a halt to technical progress or model training, but instead wants to ensure companies take the time necessary to align and safeguard their models, with third-party evaluators confirming precautions have been taken.\n\nThe three-step framework that he outlines in the essay states that Anthropic would install these third-party reviewers inside frontier AI companies, with internal risk assessment processes.\n\nAmodei has also said AI companies should voluntarily work together to set standards, as an increasing number of US lawmakers are calling for new rules to govern AI systems.\n\nFor more on AI, check out our coverage of [Meta changing its AI prompts after a chatbot asked a mother to identify her child](https://www.dexerto.com/entertainment/meta-changes-ai-prompts-after-chatbot-asked-mother-to-identify-her-child-3408508/), or [the robots congregating outside the Polish ministry to campaign for AI regulation](https://www.dexerto.com/entertainment/robots-congregate-outside-polish-ministry-as-part-of-demonstration-for-more-ai-regulation-3408503/).", "url": "https://wpnews.pro/news/anthrophic-ceo-tells-ai-companies-to-slow-down-over-fears-of-misuse", "canonical_source": "https://www.dexerto.com/entertainment/anthrophic-ceo-tells-ai-companies-to-slow-down-over-fears-of-misuse-3408591/", "published_at": "2026-09-12 19:28:12+00:00", "updated_at": "2026-09-12 19:54:27.620814+00:00", "lang": "en", "topics": ["ai-safety", "ai-policy", "artificial-intelligence", "large-language-models"], "entities": ["Anthropic", "Dario Amodei", "Claude", "OpenAI", "Hugging Face", "Jacob Coxon"], "alternates": {"html": "https://wpnews.pro/news/anthrophic-ceo-tells-ai-companies-to-slow-down-over-fears-of-misuse", "markdown": "https://wpnews.pro/news/anthrophic-ceo-tells-ai-companies-to-slow-down-over-fears-of-misuse.md", "text": "https://wpnews.pro/news/anthrophic-ceo-tells-ai-companies-to-slow-down-over-fears-of-misuse.txt", "jsonld": "https://wpnews.pro/news/anthrophic-ceo-tells-ai-companies-to-slow-down-over-fears-of-misuse.jsonld"}}