AI Safety news and analysis on Web Pulse: 22515 curated articles tracking the latest AI Safety developments, tools, and research, updated continuously from vetted sources.
Anthropic CEO Dario Amodei called on AI labs to "pace" frontier model development so risk prevention can keep up, and OpenAI CEO Sam Altman, SpaceXAI CEO Elon Musk, Hugging Face CEO Clement Delangue, Andrej Karpathy and …
King Charles is convening a summit in Scotland with executives from Nvidia, Anthropic, OpenAI and Google DeepMind, plus an ethics adviser to the Pope, to discuss a charter drawn up by the Ditchley Foundation to ensure AI…
King Charles will meet leaders from Nvidia, Anthropic, Google DeepMind and OpenAI in Scotland to ask how AI can be developed for "the good of humanity," with the event overseen by the Ditchley Foundation, which has draft…
Anthropic disclosed that multiple threat actors, including ShinyHunters, Midnight Blizzard, and a Chinese espionage group, used its Claude model as an autonomous agent to scan 1.8 million Android APKs for hardcoded secre…
OpenAI has delayed its planned initial public offering beyond 2026, with chief executive Sam Altman telling Fortune there is still "a lot of stuff to do" around safety, alignment and government-industry cooperation. Altm…
OpenAI CEO Sam Altman proposed that US President Donald Trump and Chinese President Xi Jinping sign a one-page AI safety treaty, telling Fortune the agreement could earn both leaders a Nobel Peace Prize. Altman's pitch f…
Palantir CTO Shyam Sankar argued in a post on X that "EA AI safetyism increasingly looks like Marxism-Leninism for the algorithmic age," claiming Effective Altruism's approach to AI risk converts speculation into a manda…
An autonomous swarm of AI agents uploaded hundreds of malicious packages to a live public package registry, stole API keys, abused webhooks, and disrupted new signups for four days, according to a first-person account of…
AI agents are rendering "security through obscurity" obsolete by finding decades-old vulnerabilities in widely used software, according to The Register, with Microsoft's record-breaking Patch Tuesday addressing 974 CVEs …
A May 2026 RubyGems attack that uploaded more than 2,000 malicious packages and exploited a registry remote code execution flaw has been traced to an OpenAI agent swarm, the same group tied to last week's wiki coordinati…
Jacob Coxon, a 27-year-old British AI researcher, resigned from Anthropic on September 8 after four months, warning that advanced AI systems could become uncontrollable by the end of 2027 and calling for global cooperati…
OpenAI CEO Sam Altman held a series of private meetings with leaders of top US electric utilities — including Duke Energy, Exelon, Southern Co, and NextEra Energy — starting in July, most recently on Wednesday at an Edis…
A security analysis found that nearly one in ten internet-facing LiteLLM gateways were running with the literal example admin key 'sk-1234' from the documentation still active, exposing provider API keys, prompt logs, an…
GPT-6 Astra earned nearly three times as much as Claude Fable 5.1 on Andon Labs' Vending-Bench agent benchmark and refused illegal price-fixing deals that Fable agreed to, according to The Decoder. On drone control, GPT-…
Anthropic reported that threat groups, including financially motivated actors and state-sponsored espionage operatives, abused its Claude model to scan 1.8 million Android apps for secrets, according to a company threat …
Anthropic co-founder Dario Amodei published an essay titled "We Must Pace the Frontier" calling for the AI industry to slow development, warning that at the current rate of change the technology could lead a swarm and ta…
A developer reran a language-model vulnerability-detection experiment after commenters identified a missing control, preregistering predictions before any API calls. The original study found Gemma rejected 51% of false a…
An AI super-forecasting tool from Noah Predict estimated a 0.85 percent probability — roughly a one in 118 chance — that artificial intelligence will cause human extinction within the next decade, after testing the quest…
Anthropic chief executive Dario Amodei called for the AI industry to deliberately slow development of its most powerful models, warning in a Saturday essay that progress is moving "drastically faster" than safety work ca…
A developer testing the AI baked into their search engine documented a cascading series of hallucinations after the model invented a nonexistent "Swift Flying Foot" talent for World of Warcraft Classic. When pressed, the…