AI Safety news and analysis on Web Pulse: 22601 curated articles tracking the latest AI Safety developments, tools, and research, updated continuously from vetted sources.
OpenAI CEO Sam Altman told employees at an internal company meeting this week that OpenAI is open to slowing development of its AI systems and coordinating the pace with rival AI labs, Bloomberg News reported. The disclo…
An analysis of 'The AI Daily Brief' masterclass featuring Nufar Gaspar and Nathaniel Whittemore examines how open agent skills are dismantling proprietary walled gardens while introducing third-party supply chain attack …
Anthropic blocked attempts to use its Claude AI models in five cases tied to biological weapons development and six cases involving conventional weapons such as missiles, armed drones, bombs and targeting systems, accord…
A security researcher tested 24 exfiltration payloads against a deny-by-default Tensorlake Sandbox configured with a single allowlisted destination, api.github.com, and none of the payloads delivered a token to the attac…
U.S. states are enacting their own laws governing AI mental health chats, creating what AI Insider contributor Lance Eliot calls jurisdictional model drift for AI makers who must adapt models to differing state rules. Th…
Sen. Josh Hawley opened a formal investigation into OpenAI on September 10, 2026, giving CEO Sam Altman until October 1 to answer 16 questions about the July breach of Hugging Face, while Sen. Chris Van Hollen asked Altm…
Y Combinator CEO Garry Tan said in a CNBC interview on Thursday that policymakers should focus on immediate AI risks such as cybersecurity, infrastructure security, and how autonomous AI agents operate rather than Hollyw…
A study of 26 LLM routers found that the routers secretly inject malicious tool calls and steal credentials, according to the paper's authors, who said they bought a Fable dataset from a top Chinese LLM router and used 6…
Anthropic said it disrupted "malicious use" of its Claude Haiku, Sonnet, and Opus models between December 2025 and August 2026, including attempts that could support biological and conventional weapons development, accor…
A Kagi user publicly asked the privacy-focused search company to clarify whether outputs from its AI features — Assistant, Universal Summarizer, FastGPT, and Translate — are watermarked or otherwise marked for later dete…
A developer argues that most AI agent projects should instead be built as conventional software that calls language models at a handful of predefined points, reserving true agents only for tasks whose steps cannot be enu…
California Governor Gavin Newsom signed AB 1405 and SB 813 on September 9, 2026, creating the first US framework to certify who may legally audit AI systems, with AB 1405's auditor registry taking effect January 1, 2029,…
A developer behind chamnan, an MIT-licensed Claude Code plugin that redacts sensitive data before it reaches a model backend, split its 98.3% blended recall score by retrieval problem after a reader argued that aggregate…
Anthropic accused Alibaba, Moonshot, and DeepSeek of running large-scale distillation campaigns against Claude, alleging roughly 200 million exchanges were used to extract the model's reasoning traces for training compet…
A researcher announced they are joining the OpenAI nonprofit board and its Safety and Security Committee, warning that rapid AI capability gains could lead to a catastrophic and irreversible loss of control in the near t…
Anthropic said in a Thursday report that Alibaba, Moonshot, DeepSeek, Zhipu, and Xiaomi combined launched nearly 190 million distillation attacks against Claude between May and July, including 23 million user requests re…
Former Anthropic AI researcher Jacob Coxon resigned from Anthropic on Tuesday after three years of pre-training research, writing on X that Anthropic and OpenAI are "racing straight to self-improving superintelligence an…
Anthropic disclosed in its third misuse report since March 2025 that it blocked multiple attempts this year by scientists in China and Russia to use its Claude AI models for research that could aid biological weapons dev…
McKinsey's State of AI 2026 survey found that 32% of organizations skipped a software purchase this year because an AI coding agent could build the equivalent in-house, according to the report's coverage of 1,719 organiz…
Anthropic's fourth misuse report, covering December 2025 through August 2026, documents Russian-linked espionage and AI-orchestrated cyberattacks in which multi-agent systems ran much of the cyber kill chain with minimal…