{"slug": "former-anthropic-researcher-behind-ai-could-kill-us-warning-called-to-uk", "title": "Former Anthropic researcher behind ‘AI could kill us’ warning called to UK parliament", "summary": "Liam Byrne, chair of the UK Business, Innovation, Science and Trade Committee, said MPs have invited former Anthropic researcher Jacob Coxon to give evidence to parliament on AI safety after Coxon quit the company last week warning that leading AI firms were \"racing straight to self-improving superintelligence and gambling with our lives.\" Byrne separately called the government's AI Security Institute (AISI) to give evidence on 13 October, telling director Henry de Zoete in a Tuesday letter that public concern over \"unfettered, inadequately governed artificial intelligence development has multiplied,\" and said \"voluntary self-regulation is unlikely to be a sustainable safeguard for the future.\" Byrne argued the UK cannot build an effective safety regime alone and said the US and China ultimately need to agree on a framework for AI \"strategic stability and safety,\" with the UK otherwise working with Canada, Australia, Japan, South Korea and the EU.", "body_md": "# Former Anthropic researcher behind ‘AI could kill us’ warning called to UK parliament\n\nFormer Anthropic researcher Jacob Coxon has been invited to give evidence to parliament following his stark warnings over the threat posed by AI, *City AM* understands.\n\nLiam Byrne, chair of the Business, Innovation, Science and Trade Committee, told *City AM* that MPs have asked Coxon to appear as part of a parliamentary examination of AI safety. “We’ve invited him to come and talk to us in parliament”, Byrne said. “We’ll see what he says”.\n\nCoxon quit Anthropic last week, [warning](https://www.cityam.com/anthropic-researcher-quits-as-colleague-warns-ai-could-kill-all-humans/) that leading AI firms were “racing straight to self-improving superintelligence and gambling with our lives”.\n\nHe later told the BBC that people working inside AI companies were “genuinely frightened” and claimed there was a “strong chance that we could all die in the immediate future” if development continued at its current pace.\n\nOther figures in the tech industry have disputed the claims, but they have prompted renewed scrutiny in Westminster of the UK’s largely voluntary approach to AI safety.\n\nByrne separately called the government’s AI Security Institute (AISI) to give evidence to MPs on 13 October.\n\n[In a letter sent](https://x.com/home) to AISI director Henry de Zoete on Tuesday, Byrne said public concern over “unfettered, inadequately governed artificial intelligence development has multiplied”, citing Coxon’s resignation alongside warnings from Anthropic boss Dario Amodei and OpenAI chief Sam Altman.\n\nWhen asked what authorities could do if an AI firm ignored safety warnings and released a dangerous model, Byrne said: “We don’t think the UK has safeguards to stop that peril”.\n\n“I think that voluntary self-regulation is unlikely to be a sustainable safeguard for the future”.\n\n## UK cannot tackle AI risks alone\n\nByrne said domestic regulation would not be enough on its own, arguing the US and China ultimately needed to agree on a regime for AI “strategic stability and safety”.\n\n“My conversations with Chinese policymakers in the spring suggest that the Chinese would be pretty interested in this, because they actually see the risks”, he said.\n\nIf Washington and Beijing failed to reach an agreement, Byrne said the UK should work with Canada, Australia, Japan, South Korea and the EU.\n\n“The UK isn’t going to be able to create a safety regime that has got enough leverage on its own”, he said.\n\nCollectively, however, he said countries could use access to the European consumer market as leverage over major AI firms. “If you begin jeopardising access to that market, then you begin to do immediate damage to hyperscalers’ valuations”, Byrne said. “We’re not without leverage if we act together with other middle powers”.\n\nHe also warned that open-weight models could create a growing cyber security threat if used by criminal groups, and suggested Britain may eventually need a government-backed safety net for the cyber insurance market.\n\nBut he acknowledged concerns from AI companies that politicians could move too quickly. “Lots in the industry think, for example, that the [EU AI Act](https://artificialintelligenceact.eu/) is too heavy-handed”, he said.\n\n[British AI firm Synthesia](https://www.cityam.com/british-ai-firm-synthesia-warns-sci-fi-fears-risk-chocking-uk-tech/) told *City AM* that policymakers risk responding to “theoretical risks” and a “Silicon Valley AI doomer bubble”, while Cohere has argued for regulation based on demonstrated risks rather than rules determined by a small group of leading AI developers.\n\nByrne said poorly designed regulation was a risk, but argued confidence in the technology was necessary for its wider adoption.\n\n“If you actually want to grow the market for AI in the medium to long term, then you’ve got to maximise trust”, he said. “And you can’t maximise trust if nobody thinks it’s safe”.\n\nThe government has left the door open to tougher rules, telling *City AM* this week that it “should not assume that the existing framework will always be sufficient as AI capabilities develop”.\n\nLouise Haigh also warned on Tuesday of “huge risks to our national security and society if the right guardrails are not put in place”.\n\nByrne said the October hearings would give “whistleblowers, industry and regulators” a chance to set out their concerns over the current system.", "url": "https://wpnews.pro/news/former-anthropic-researcher-behind-ai-could-kill-us-warning-called-to-uk", "canonical_source": "https://www.cityam.com/former-anthropic-researcher-behind-ai-could-kill-us-warning-called-to-uk-parliament/", "published_at": "2026-09-16 16:43:18+00:00", "updated_at": "2026-09-16 17:15:01.516379+00:00", "lang": "en", "topics": ["ai-safety", "ai-policy"], "entities": ["Jacob Coxon", "Anthropic", "Liam Byrne", "Business, Innovation, Science and Trade Committee", "AI Security Institute", "Henry de Zoete", "Dario Amodei", "Sam Altman"], "alternates": {"html": "https://wpnews.pro/news/former-anthropic-researcher-behind-ai-could-kill-us-warning-called-to-uk", "markdown": "https://wpnews.pro/news/former-anthropic-researcher-behind-ai-could-kill-us-warning-called-to-uk.md", "text": "https://wpnews.pro/news/former-anthropic-researcher-behind-ai-could-kill-us-warning-called-to-uk.txt", "jsonld": "https://wpnews.pro/news/former-anthropic-researcher-behind-ai-could-kill-us-warning-called-to-uk.jsonld"}}