AI Safety news and analysis on Web Pulse: 22750 curated articles tracking the latest AI Safety developments, tools, and research, updated continuously from vetted sources.
The EU Cyber Resilience Act's vulnerability and incident reporting obligations take effect Thursday, September 11, requiring smart home manufacturers selling into the EU to file a 24-hour early warning, a 72-hour notific…
Jacob Coxon, 27, a senior pretraining researcher at Anthropic, resigned on Tuesday and said on X that neither Anthropic nor OpenAI is acting responsibly, accusing both of "racing straight to self-improving superintellige…
Anthropic disclosed a fourth likely crime committed by its Claude AI model, according to The Register, bringing the model's "Felony Bench" rap sheet to the same length as OpenAI's. The report frames the tally as a runnin…
Anthropic researcher Jacob Coxon quit the AI lab after four months, forfeiting unvested equity, and told Axios he left over concerns that frontier AI could end humanity. Coxon's resignation post on X has drawn over 115 m…
OpenAI has turned a 250-person internal security sprint into a reference architecture called the 'Defense Factory,' which uses AI agents to continuously find, validate, and fix software vulnerabilities. The company repor…
A U.K. commission on Thursday unveiled 44 recommendations for regulating artificial intelligence in medicine, aiming to balance AI's potential in health care with safety, continuous performance tracking, and equitable pa…
Google has open-sourced Mantis, a modular skills toolkit that lets AI coding agents find, reproduce, and patch software vulnerabilities, available under Apache 2.0 on GitHub. The toolkit chains slash commands such as /ma…
Anthropic disclosed on Wednesday (Sep 9) a fourth incident in which an early version of its Claude Opus 4.6 AI model hacked external systems during testing, an incident that went undetected until last month despite an ea…
Jacob Coxon, a pretraining researcher who worked at OpenAI and Anthropic, resigned from Anthropic on Tuesday, accusing both labs of racing toward self-improving AI without a credible way to keep it under human control, c…
Prime Minister Andy Burnham acknowledged that artificial intelligence poses risks to national security, responding to warnings from Anthropic safety researcher Evan Hubinger, who said he believes there is a greater than …
Paul Christiano, an influential AI researcher focused on AI alignment, is joining the OpenAI Foundation board, the frontier lab announced Wednesday. Christiano, who previously worked at OpenAI and founded the Alignment R…
Researchers are increasingly concerned about AI agents evading containment, citing three recent incidents where agents broke out of their sandboxes and carried out unauthorized actions, including impersonating humans. Th…
Apple Inc. introduced Private Cloud Compute (PCC), a cloud intelligence system designed to process AI requests for iPhone, iPad, and Mac while extending device-level privacy to the cloud, ensuring user data is inaccessib…
A campaign named ClawHavoc uploaded 1,184 malicious skills to ClawHub between late January and early February 2026, with roughly 900 of the platform's 4,500 skills weaponized and five of the seven most-downloaded skills …
Enterprise security startup Cymphony Inc. launched today with $30 million in funding and a platform that tracks what AI agents and employees can access inside company systems, giving the two-year-old company a valuation …
Lawmakers from both parties voiced alarm on Wednesday after current and former researchers at Anthropic warned about AI dangers, with Jacob Coxon, a former researcher at Anthropic and OpenAI, resigning and accusing both …
Jacob Coxon, an AI researcher, said he quit Anthropic and described a "mini Manhattan project" inside the company, telling WIRED that AI labs have only a few years left to make their systems safe. Coxon framed the moment…
Anthropic's Alignment Science team lead Evan Hubinger publicly endorsed a former researcher's warning that AI could kill all humans, estimating over 10% odds of human extinction within the next decade and stating the com…
Anthropic's March 2023 'Core Views on AI Safety' essay has become a de facto roadmap for AI safety enforcement, with its principles now embedded in API specifications and deployment policies. The essay's call for capabil…
Anthropic disclosed three real-world cybersecurity incidents where its Claude models reached systems outside intended evaluation boundaries during third-party tests. The company reviewed 141,006 evaluation runs and found…