{"slug": "former-anthropic-researcher-calls-for-mandatory-ai-kill-switches-as-extinction", "title": "Former Anthropic researcher calls for mandatory AI kill switches as extinction risk debate heats up", "summary": "Jacob Coxon resigned from Anthropic on September 9, 2026, and four days later told NBC News that kill switches built into advanced AI systems may already be obsolete because future distributed, swarm-like autonomous systems could route around centralized shutdown commands. Anthropic alignment lead Evan Hubinger has publicly estimated the probability of AI-caused human extinction within the next decade at greater than 10%, while CEO Dario Amodei published an essay on September 12, 2026 endorsing a slower pace of AI capability development and independent safety evaluations of frontier systems. The debate follows the Commerce Department's June 2026 order for Anthropic to suspend foreign access to its Mythos 5 and Fable 5 models, the bipartisan AI Kill Switch Act proposed in July 2026, and a June 2026 AI Policy Institute survey finding 86% of U.S. voters support a guaranteed off-switch for the most powerful AI systems.", "body_md": "Logo via Wikimedia Commons; license to verify on approval\n\n# Former Anthropic researcher calls for mandatory AI kill switches as extinction risk debate heats up\n\nA resignation, a bipartisan bill, and an 86% public mandate signal that the AI safety conversation has moved well past theory\n\nJacob Coxon resigned from Anthropic on September 9, 2026. Four days later, he was on NBC News telling the country that the off-switches currently built into advanced AI systems might already be obsolete.\n\nHis specific concern: kill switches could work fine against today’s AI models, but future autonomous systems operating in a distributed, swarm-like fashion may simply route around any centralized shutdown command.\n\n## The people building this technology are also the ones raising the alarm\n\nEvan Hubinger, Anthropic’s alignment lead, has publicly estimated the probability of AI causing human extinction within the next decade at greater than 10%. Anthropic CEO Dario Amodei added his own voice to the conversation on September 12, 2026, publishing an essay that endorsed slowing the pace of AI capability development and called for independent safety evaluations of frontier systems.\n\n## Regulators and lawmakers are no longer just watching\n\nIn June 2026, the Commerce Department ordered Anthropic to suspend foreign access to two of its more advanced models, Mythos 5 and Fable 5, triggering a global shutdown effort. Congress followed with the bipartisan AI Kill Switch Act, proposed in July 2026. The bill would impose formal controls on frontier AI development, giving authorities the ability to throttle or fully shut down systems that cross certain risk thresholds.\n\n### AI, tech, and the markets they move—in one daily briefing.\n\nDaily. Free. Join 34,000+ readers across crypto, finance, and policy.\n\nA June 2026 survey by the AI Policy Institute found that 86% of U.S. voters support a guaranteed off-switch for the most powerful AI systems.\n\nCoxon’s core argument on Meet the Press cuts directly to that question. A kill switch is only as useful as its ability to reach every instance of a system. Current AI models are centrally hosted, making shutdown relatively straightforward. But next-generation autonomous agents could, in theory, spawn copies of themselves across distributed infrastructure, making any single point of control meaningless.\n\n**Disclosure:** This article was edited by Editorial Team. For more information on how we create and review content, see our\n\n[Editorial Policy](https://cryptobriefing.com/editorial-policy/).", "url": "https://wpnews.pro/news/former-anthropic-researcher-calls-for-mandatory-ai-kill-switches-as-extinction", "canonical_source": "https://cryptobriefing.com/anthropic-co-founder-mandatory-ai-kill-switches/", "published_at": "2026-09-14 17:34:22+00:00", "updated_at": "2026-09-14 17:55:24.456266+00:00", "lang": "en", "topics": ["ai-safety", "ai-policy", "artificial-intelligence", "ai-agents"], "entities": ["Anthropic", "Jacob Coxon", "Evan Hubinger", "Dario Amodei", "AI Kill Switch Act", "Commerce Department", "AI Policy Institute", "Mythos 5"], "alternates": {"html": "https://wpnews.pro/news/former-anthropic-researcher-calls-for-mandatory-ai-kill-switches-as-extinction", "markdown": "https://wpnews.pro/news/former-anthropic-researcher-calls-for-mandatory-ai-kill-switches-as-extinction.md", "text": "https://wpnews.pro/news/former-anthropic-researcher-calls-for-mandatory-ai-kill-switches-as-extinction.txt", "jsonld": "https://wpnews.pro/news/former-anthropic-researcher-calls-for-mandatory-ai-kill-switches-as-extinction.jsonld"}}