{"slug": "anthropic-argues-for-government-authority-to-block-risky-ai-models", "title": "Anthropic argues for government authority to block risky AI models", "summary": "Anthropic CEO Dario Amodei proposed a regulatory framework on June 10 that would grant the US government authority to block AI models deemed to pose \"unacceptable risks,\" including those enabling cybersecurity threats or biological weapons development. The plan mandates third-party testing for frontier AI models before deployment, with civil penalties tied to a company's global annual revenue for noncompliance. The proposal comes amid Anthropic's ongoing legal dispute with the Pentagon over safety guardrails on its Claude models, which the company refused to remove for autonomous weapons and mass surveillance applications.", "body_md": "# Anthropic argues for government authority to block risky AI models\n\nThe Claude maker wants mandatory third-party audits and federal power to halt dangerous AI deployments, even as it fights the Pentagon over safety guardrails.\n\nAnthropic CEO Dario Amodei just asked the federal government to do something most tech executives would rather chew glass than suggest: regulate his own industry. Hard.\n\nOn June 10, Amodei unveiled what he’s calling an “Advanced AI Framework,” a regulatory blueprint that would give the US government the authority to block AI models deemed to present “unacceptable risks.” That includes models capable of enabling cybersecurity threats or aiding in the development of biological weapons.\n\n## What the framework actually proposes\n\nThe core of Amodei’s proposal centers on mandatory third-party testing for frontier AI models. Before a powerful new model hits the market, independent auditors would stress-test it for dangerous capabilities, similar to how pharmaceuticals go through clinical trials or aircraft undergo safety certifications before carrying passengers.\n\nIf a model fails those tests, the government could block its deployment entirely.\n\nThe framework also proposes significant civil penalties tied to a company’s global annual revenue for noncompliance.\n\nAmodei is also advocating for a graduated approach, starting with softer regulatory measures that could intensify over time as AI capabilities advance.\n\nThere’s also an “Economic Policy Framework” baked into the proposal, aimed at supporting workers displaced by AI-related job losses.\n\n## The Pentagon problem\n\nIn February, Anthropic refused Pentagon demands to remove safety guardrails from the Claude family of models. Those guardrails are specifically designed to prevent the use of AI in autonomous weapons systems and domestic mass surveillance. The refusal sparked a legal dispute centered on supply-chain risks.\n\nJust days before Amodei’s announcement, there were calls within the broader AI industry for a pause in advanced AI development, reflecting growing concern about the pace of progress outstripping anyone’s ability to manage it.\n\n## What this means for the AI investment landscape\n\nThe framework could create a meaningful competitive moat for companies that already invest heavily in safety infrastructure. If third-party audits become mandatory, firms that have been treating safety as an afterthought will face steep adjustment costs. Companies like Anthropic, which have built safety considerations into their development process from day one, would have a structural advantage.\n\nRevenue-based penalties add another layer of risk for investors to consider. A company generating tens of billions in annual revenue could face penalties in the hundreds of millions or more for deploying a model that regulators flag as dangerous.\n\nThe Pentagon dispute also raises questions about the government contracting pipeline for AI companies. Anthropic’s refusal to strip safety features suggests that some companies may be willing to walk away from government dollars rather than compromise on principles.\n\n**Disclosure:** This article was edited by Editorial Team. For more information on how we create and review content, see our\n\n[Editorial Policy](https://cryptobriefing.com/editorial-policy/).", "url": "https://wpnews.pro/news/anthropic-argues-for-government-authority-to-block-risky-ai-models", "canonical_source": "https://cryptobriefing.com/anthropic-government-block-risky-ai-models/", "published_at": "2026-06-11 23:55:48+00:00", "updated_at": "2026-06-12 00:55:45.385041+00:00", "lang": "en", "topics": ["ai-policy", "ai-safety", "artificial-intelligence", "large-language-models"], "entities": ["Anthropic", "Dario Amodei", "Pentagon"], "alternates": {"html": "https://wpnews.pro/news/anthropic-argues-for-government-authority-to-block-risky-ai-models", "markdown": "https://wpnews.pro/news/anthropic-argues-for-government-authority-to-block-risky-ai-models.md", "text": "https://wpnews.pro/news/anthropic-argues-for-government-authority-to-block-risky-ai-models.txt", "jsonld": "https://wpnews.pro/news/anthropic-argues-for-government-authority-to-block-risky-ai-models.jsonld"}}