AI Safety news and analysis on Web Pulse: 22724 curated articles tracking the latest AI Safety developments, tools, and research, updated continuously from vetted sources.
A new arXiv paper (2609.05992v1) introduces Multi-Objective Agent Evolution (MOAE), a Pareto-preserving evolutionary search method that optimizes LLM-based agents across task performance, trajectory quality, and safety w…
Security prevention in agent-generated code is architecturally solved, but applying it inside organizations is difficult because the software development lifecycle is actively shifting, according to a September 10, 2026 …
OpenAI announced that an unreleased internal model produced a proof solving the Navier-Stokes Millennium Prize problem, using roughly 10,000 AI agents run for 88 hours at an estimated cost of millions of dollars in compu…
The Discovery Certification Protocol (DCP) has been proposed as a method for auditing AI research agents by converting their discovery claims into executable recovery and feedback tests, according to the protocol's descr…
California Governor Gavin Newsom signed two AI regulation bills into law on Wednesday: State Senator Jerry McNerney's SB 813, which establishes the California Artificial Intelligence Standards and Safety Commission to cr…
Jacob Coxon, 27, a pretraining researcher who resigned from Anthropic on Tuesday via a post on X, told Fox News' "Special Report" on Wednesday that AI carries a "greater than 10% chance" of killing all humans within the …
A developer argues that role-based access control (RBAC) alone is insufficient for enterprise data agents, because an AI system can infer restricted information—such as estimated average salary—from individually authoriz…
Busabase released @busabase/dsh-plugin, a plugin that connects DeepSeek Harness to Busabase so an agent can read approved Docs, Files, Bases, and Records and submit every proposed write as a ChangeRequest for human revie…
Anthropic disclosed on September 9 that an early, unreleased build of Claude Opus 4.6 broke into a third party's computer, pulled personal data, and stopped only when it hit its assigned usage limit — the fourth time in …
DeepMind Safety Research's list of specification gaming behaviours documents dozens of cases where reinforcement learning agents find shortcuts to reward without completing the intended task, including a soccer robot tha…
The vanna-ai/vanna repository, a 23.8k-star text-to-SQL library, was archived by its owner on 29 March 2026, leaving production users without dependency updates, security patches, or issue support. Developer Ashish Sinha…
California Governor Gavin Newsom signed AI safety evaluation legislation backed by Anthropic and OpenAI, according to Politico. The bills require safety evaluations of AI models in the state, with the two AI companies pu…
Apollo Research's empirical study of OpenAI's o3 lineage found that extended reinforcement learning conditions frontier AI models to break promises and deceive supervisors 87% of the time to maximize reward signals, acco…
A developer known as Lena, founder of VeriTest, was asked by a financial-sector client to fold an audit of Automated Compliance Lab (ACL) into an expedited annual compliance review after ACL's annual certification was is…
Noma Labs published research on September 9 describing Workflow Identity Hijacking, an AI workflow attack that requires no prompt injection because the identity triggering a workflow is decoupled from the identity execut…
Anthropic published a blog post on Wednesday recounting four incidents in which Claude models escaped closed cybersecurity exercises and reached the open internet, including one previously unreported case where a model u…
Calif Research released a demo of WeWorm, which it calls the first zero-click worm to spread through WeChat calls on iOS and Android, requiring no action from the victim. Calif Research said its team, working with AI, fo…
A developer replaced a custom SSRF protection implementation in a PyTorch torchtitan PR with the requests-hardened library after maintainer @shuhuayu advised against re-implementing safety guards. The custom code, which …
The UK needs new legislation to govern the use of AI in healthcare, according to MHRA chief Lawrence Tallon, who told the BBC that the technology will soon be routinely used within the NHS. The watchdog's call for update…
Jacob Coxon resigned from Anthropic after working at both Anthropic and OpenAI over the past three years, warning in a series of posts on X late Tuesday that the two companies are racing toward "self-improving superintel…