cd /news/ai-safety/someone-tried-to-develop-biological-… · home topics ai-safety article
[ARTICLE · art-126741] src=metro.co.uk ↗ pub= topic=ai-safety verified=true sentiment=↓ negative

Someone tried to develop biological weapons using Claude

Anthropic said in its latest threat intelligence report that it blocked an attempt to use its Claude AI model to develop biological weapons, and that Russian-based cyber criminals and Iranian propaganda actors also tried to use the model for malicious purposes. Anthropic's head of threat intelligence told the New York Times the biological-weapon attempt was 'incredibly nuanced' and that the company's safeguards stopped the malicious attempts. The disclosure came the same week that 27-year-old Anthropic researcher Jacob Coxon quit, telling colleagues on Slack that without international coordination 'we will incur a risk of causing human extinction.'

by read2 min views1 publishedSep 11, 2026
Someone tried to develop biological weapons using Claude
Image: Metro (auto-discovered)

One of the world’s largest AI models has said it blocked an attempt to develop biological weapons using its technology.

Anthropic, operator of Claude, said in its latest threat intelligence report that Russian-based cyber criminals and Iranian propaganda actors tried to use the AI model for malicious reasons.

Biological ‘misuse’ is one of the most severe risks facing the AI model, they added.

Other cases of misuse included attempts to develop software for ‘conventional weapons, including firearms, missiles, armed drones, bombs, and other munitions, as well as the targeting and control systems that operate them’.

The same information that can be used to develop a biological weapon could also be used to develop, for example, a vaccine or a cure for a disease,’ Anthropic said.

But the head of threat intelligence at Anthropic stressed that the attempt to create a biological weapon was ‘incredibly nuanced’.

‘You are not seeing someone in a comic book kind of way say, ‘Hey, I want to build a biological weapon to kill everybody,’” he told the New York Times.

Anthropic has safeguards in place and was able to stop the malicious attempts on their LLM.

Earlier this week, a researcher at Anthropic told his colleagues he was leaving by saying they were ‘causing human extinction’.

Jacob Coxon, 27, joined Anthropic earlier this year to train its bots by giving them huge amounts of data after leaving ChatGPT-maker OpenAI.

Coxon quit on Tuesday and told his colleagues on Slack that he was sad to say goodbye to his fellow ‘Ants’, a term for Anthropic employees.

‘Like many of you,’ his message continued, ‘I think that without international coordination we will incur a risk of causing human extinction.

‘I’ve recently become more concerned about the degree and imminence of this risk. I also find myself viscerally fearing the intelligence explosion where previously those concerns were unemotional.’

The messages, obtained by NBC News, came hours before Coxon posted on X, warning that the AI arms race threatens human civilisation.

‘The people building AI earnestly believe that it could kill us all by the end of the decade,’ he wrote.

‘This is not a marketing stunt. If anything, many executives and senior researchers will couch their phrasing in the press to sound sensible – but I hear the same people express fear privately. No other human activity poses this level of danger.’

Get in touch with our news team by emailing us at webnews@metro.co.uk.

**For more stories like this,** [**check our news page**](https://metro.co.uk/news/).

MORE: [Security guard imported hundreds of illegal zombie knives and sold them to kids](https://metro.co.uk/2026/09/10/security-guard-imported-hundreds-illegal-zombie-knives-sold-kids-29581448/?ico=more_text_links)

MORE: [Hundreds of officers and veterans pay tribute to war hero PC killed in A66 crash](https://metro.co.uk/2026/09/10/hundreds-officers-veterans-pay-tribute-war-hero-pc-killed-a66-crash-29581073/?ico=more_text_links)

MORE: [Upskirting website vanishes suddenly after Metro investigation](https://metro.co.uk/2026/09/10/london-upskirting-website-uncovered-metro-suddenly-inaccessible-29580191/?ico=more_text_links)
── more in #ai-safety 4 stories · sorted by recency
── more on @anthropic 3 stories trending now
sponsored brought to you by zahid.host 4,200+ EU-deployed projects
reading about agents? ship yours in a single git push.

Run your AI side-project on zahid.host

EU-based hosting, git-push deploys, automatic HTTPS, no cold starts. Free tier with a custom domain — perfect for shipping the agent you just read about.

$git push zahid main
Live at https://your-agent.zahid.host
Get free account → Pricing
from €0/mo · no card required
LIVE [news/someone-tried-to-dev…] indexed:0 read:2min 2026-09-11 ·