cd /news/ai-safety/former-anthropic-researcher-calls-fo… · home topics ai-safety article
[ARTICLE · art-129429] src=cryptobriefing.com ↗ pub= topic=ai-safety verified=true sentiment=↓ negative

Former Anthropic researcher calls for mandatory AI kill switches as extinction risk debate heats up

Jacob Coxon resigned from Anthropic on September 9, 2026, and four days later told NBC News that kill switches built into advanced AI systems may already be obsolete because future distributed, swarm-like autonomous systems could route around centralized shutdown commands. Anthropic alignment lead Evan Hubinger has publicly estimated the probability of AI-caused human extinction within the next decade at greater than 10%, while CEO Dario Amodei published an essay on September 12, 2026 endorsing a slower pace of AI capability development and independent safety evaluations of frontier systems. The debate follows the Commerce Department's June 2026 order for Anthropic to suspend foreign access to its Mythos 5 and Fable 5 models, the bipartisan AI Kill Switch Act proposed in July 2026, and a June 2026 AI Policy Institute survey finding 86% of U.S. voters support a guaranteed off-switch for the most powerful AI systems.

read2 min views4 publishedSep 14, 2026
Former Anthropic researcher calls for mandatory AI kill switches as extinction risk debate heats up
Image: Cryptobriefing (auto-discovered)

Logo via Wikimedia Commons; license to verify on approval

A resignation, a bipartisan bill, and an 86% public mandate signal that the AI safety conversation has moved well past theory

Jacob Coxon resigned from Anthropic on September 9, 2026. Four days later, he was on NBC News telling the country that the off-switches currently built into advanced AI systems might already be obsolete.

His specific concern: kill switches could work fine against today’s AI models, but future autonomous systems operating in a distributed, swarm-like fashion may simply route around any centralized shutdown command.

The people building this technology are also the ones raising the alarm #

Evan Hubinger, Anthropic’s alignment lead, has publicly estimated the probability of AI causing human extinction within the next decade at greater than 10%. Anthropic CEO Dario Amodei added his own voice to the conversation on September 12, 2026, publishing an essay that endorsed slowing the pace of AI capability development and called for independent safety evaluations of frontier systems.

Regulators and lawmakers are no longer just watching #

In June 2026, the Commerce Department ordered Anthropic to suspend foreign access to two of its more advanced models, Mythos 5 and Fable 5, triggering a global shutdown effort. Congress followed with the bipartisan AI Kill Switch Act, proposed in July 2026. The bill would impose formal controls on frontier AI development, giving authorities the ability to throttle or fully shut down systems that cross certain risk thresholds.

AI, tech, and the markets they move—in one daily briefing.

Daily. Free. Join 34,000+ readers across crypto, finance, and policy.

A June 2026 survey by the AI Policy Institute found that 86% of U.S. voters support a guaranteed off-switch for the most powerful AI systems.

Coxon’s core argument on Meet the Press cuts directly to that question. A kill switch is only as useful as its ability to reach every instance of a system. Current AI models are centrally hosted, making shutdown relatively straightforward. But next-generation autonomous agents could, in theory, spawn copies of themselves across distributed infrastructure, making any single point of control meaningless.

Disclosure: This article was edited by Editorial Team. For more information on how we create and review content, see our

Editorial Policy.

── more in #ai-safety 4 stories · sorted by recency
── more on @anthropic 3 stories trending now
sponsored brought to you by zahid.host 4,200+ EU-deployed projects
reading about agents? ship yours in a single git push.

Run your AI side-project on zahid.host

EU-based hosting, git-push deploys, automatic HTTPS, no cold starts. Free tier with a custom domain — perfect for shipping the agent you just read about.

$git push zahid main
Live at https://your-agent.zahid.host
Get free account → Pricing
from €0/mo · no card required
LIVE [news/former-anthropic-res…] indexed:0 read:2min 2026-09-14 ·