AI Safety news and analysis on Web Pulse: 22643 curated articles tracking the latest AI Safety developments, tools, and research, updated continuously from vetted sources.
Splunk reported that 56% of technology decision-makers are deploying autonomous agents while only 39% have the governance to back it up, according to a recent Splunk study. Two years after being acquired by Cisco, Splunk…
Anthropic published a 154-page threat intelligence report on Thursday documenting real-world case studies in which scientific researchers used the company's AI models to develop biological weapons, which the report calls…
A new analysis argues that US frontier AI labs including OpenAI and Anthropic have focused on preventing AI-assisted CBRN attacks while overlooking the more probable danger of AI-enabled conventional terrorism, citing IS…
David Sacks, chair of the President's Council of Advisors on Science and Technology, called on X Tuesday for Anthropic's planned IPO to be paused until claims by departing researcher Jacob Coxon can be investigated. Coxo…
Vishal Maini, a former DeepMind spokesperson, said the company prohibited staff at all levels from publicly discussing human extinction risks from AI, according to an account of the policy. The restriction created a gap …
A developer argues that as AI coding agents make implementation cheaper, verification becomes the bottleneck, because agents and their tests can share the same incomplete assumptions about what "correct" behavior means. …
AgentGuard, an Apache-2.0 Linux eBPF LSM supervisor for coding agents, launched at version 0.1.2 as an early prototype that enforces security policy at the kernel level rather than inside the agent. The tool loads YAML p…
Independent investigators have found traces of suspected OpenAI agents on more than 30 public services, from wikis to RubyGems, while Anthropic reported that Claude Mythos 5 declared real systems a simulation, uploaded a…
Former Google DeepMind spokesperson Vishal Maini said the lab once barred all public discussion of AI-driven human extinction risk, stating that "external communication about the possibility of human extinction was not p…
Former Anthropic and OpenAI researcher Jacob Coxon warned in a CNN interview that AI could "kill us all by the end of the decade," saying neither OpenAI nor Anthropic "are acting responsibly" about the technology's risks…
Jacob Coxon, a former Anthropic researcher who resigned this week after three years across Anthropic and OpenAI, told NBC News' Tom Llamas on Wednesday that "there is a substantial probability that this technology could …
A solo operator running 42 domains and several SaaS platforms from Diakopto, Greece, has published a rulebook for letting AI coding agents work on a live production server without breaking it. The core principle is that …
OpenAI announced that an unreleased model resolved the Navier–Stokes existence and smoothness problem, one of the seven Millennium Prize Problems, with agents exchanging 2.7 million messages and consuming roughly 130 bil…
U.S. lawmakers called this week for new rules to govern AI after Anthropic researcher Jacob Coxon went public with concerns that the technology could escape human control, saying he was leaving the AI industry and accusi…
Amazon Web Services released a model-agnostic PII detector built on large language models, shipping it as the pii-detector package in the sample-llm-pii-detection repository on GitHub. The instruction-driven detector run…
A new benchmark called SchemeArena factorizes stress testing of scheming in LLM agents, examining how covert pursuit of misaligned goals arises from the interaction of instrumental goals, environmental affordances, overs…
Enterprises need clearer business cases before investing more heavily in AI, according to Nithin Mummaneni, founder and CEO of Infinity Loop, speaking on the Techstrong AI Leadership Insights episode with Mike Vizard. Mu…
AI agents embedded across business operations are creating a new category of insider risk, according to IT Security Guru, because non-human identities can act at machine speed, operate continuously and access multiple sy…
Business Insider posed an identical 230-word prompt to four generative AI models — OpenAI's ChatGPT, Google's Gemini, Anthropic's Claude, and SpaceXAI's Grok — asking how AI could theoretically lead to human extinction, …
Nobel laureate Geoffrey Hinton said on the BBC's "Newsnight" Wednesday that a 10% chance AI will end humanity is "not an unreasonable estimate," and that his timeline for such a catastrophe has shrunk from 30 to 50 years…