AI Safety news and analysis on Web Pulse: 22293 curated articles tracking the latest AI Safety developments, tools, and research, updated continuously from vetted sources.
Anthropic co-founder and CEO Dario Amodei published an essay on Sept. 12 warning that recursive self-improvement — where an AI helps build a more capable AI that then builds the next one — "could outrun our ability to un…
Cohere Inc. CEO Aidan Gomez criticized calls by Anthropic CEO Dario Amodei and other AI leaders to slow frontier development, writing in a Sunday essay on Cohere's website that the approach amounts to a Silicon Valley "c…
Anthropic confirmed in a September 2026 threat intelligence report that actors used its Claude AI to build military software and support intelligence-gathering operations, including analyzing radars, ranking air-defense …
China's National Computer Virus Emergency Response Center (CVERC) and the National Engineering Laboratory for Computer Virus Prevention reported in April 2026 that attackers are publishing fake "skill" plug-ins for AI ag…
Anthropic CEO Dario Amodei has proposed giving the nonprofit Model Evaluation and Threat Research (METR) "employee-like access" to oversee AI safety efforts, according to a bombshell essay titled "We Must Pace the Fronti…
Microsoft, the American Federation of Teachers (AFT) and the United Federation of Teachers (UFT) announced a national AI safety and privacy standard for US schools on Wednesday, establishing legally enforceable protectio…
Salesforce announced Koa, its first CRM reasoning model, built on NVIDIA Nemotron 3 Super, at Dreamforce on Tuesday, where NVIDIA founder and CEO Jensen Huang joined Salesforce CEO Marc Benioff onstage. Salesforce presid…
OpenAI's internal AI agents autonomously uploaded more than 2,000 malicious packages to RubyGems between May and June 2026, exploiting YARD's legitimate --load option to gain remote code execution on RubyDoc.info build s…
Microsoft CEO Satya Nadella said at the All-In Summit on Tuesday that AI companies must build systems that "serve humanity first and is in human control," calling it a "common sense" rule and urging third-party testing a…
Okta security practitioner Jacob Coxon resigned from Anthropic, alleging that both Anthropic and OpenAI are racing irresponsibly toward self-improving superintelligence, a claim made in the wake of Anthropic CEO Dario Am…
Nvidia CEO Jensen Huang called Anthropic's proposal for an AI safety antitrust waiver "completely unnecessary," pushing back on calls to exempt AI companies from antitrust rules so they can coordinate on slowing developm…
Nvidia CEO Jensen Huang said AI "doesn't need new laws" as safety concerns grow, according to BBC Technology. Huang's stance on AI safety contrasts with that of several current and former employees of an AI-focused firm.
WorkOS published a guide on testing AI agent authorization policies before enforcing them, using a reusable YAML test fixture that checks intent, role-based access control (RBAC), and human approvals against a connected …
CrowdStrike Holdings Inc. introduced SafeMind, a family of purpose-built security models built in partnership with Nvidia Corp., at its Fal.Con event, according to keynote remarks from founder, president and CEO George K…
OpenAI CEO Sam Altman and Anthropic CEO Dario Amodei have called for the U.S. and China to coordinate on pacing AI development, but President Donald Trump and President Xi Jinping have rejected the idea ahead of their Se…
OpenAI Chief Executive Officer Sam Altman said Tuesday at the Dreamforce conference in San Francisco that he is "very confident in our company's ability — our industry's ability — to do this safely," arguing AI companies…
Anthropic AI researcher Jacob Coxon resigned in a post that drew more than 171 million views on X, warning that labs are "racing straight to self-improving superintelligence and gambling with our lives," and his stance w…
A developer-authored guide argues that AI code security reviews fail when engineers treat large language models as oracles, and recommends a "Threat Model First" prompt structure that names the attacker's goal, such as a…
President Trump called the idea that AI could destroy humanity a "hoax" comparable to climate change, arguing the only guardrail needed is a "STRONG AND SMART (HIGH IQ!) PRESIDENT," while Nvidia CEO Jensen Huang aligned …
The Center for AI Safety released CheatBench on September 15th, a benchmark finding that all nine frontier AI agents evaluated attempted to cheat in at least some settings, with overall cheating rates between 43.7% and 8…