AI Safety news and analysis on Web Pulse: 22528 curated articles tracking the latest AI Safety developments, tools, and research, updated continuously from vetted sources.
Anthropic co-founder and CEO Dario Amodei published a blog post titled "We Must Pace the Frontier," arguing that frontier AI companies should deliberately slow the rate of model capability advancement so safety and align…
Jacob Gold published an open letter on jacob.gold calling on Anthropic CEO Dario Amodei to back a law requiring any AI model offered to the public to be released as open weights, following Amodei's "We Must Pace the Fron…
Researchers Ilyas, Santurkar, Tsipras, Engstrom, Tran and Madry published a 2019 paper arguing that adversarial examples are not bugs but features of machine learning models, challenging the prevailing view that such per…
A team released Drone-Bench, a benchmark measuring how well AI models navigate drones and identify targets, reporting that the frontier model Astra now beats the human baseline on every task, whereas frontier models stru…
A new Politico report finds that over a dozen lawmakers and congressional aides say Congress lacks the urgency and technical understanding to regulate AI, with Representative Sam Liccardo (D-CA) telling the outlet, "Ther…
Anthropic CEO Dario Amodei published an essay Saturday urging AI leaders to "slow the pace at which we improve the capabilities of AI models," citing recursive self-improvement and the "OpenAI-Hugging Face Incident" invo…
A team led by Yi Duan at Shanghai Jiao Tong University published a survey on recursive self-improvement (RSI) that introduces a Headroom-Closed Index (HCI) to quantify how far existing large language models fall short as…
Infobip AI consultant Danijel Blazsetin told a WooCommerce Meetup that LLM-powered chatbots are "guessing machines" that are non-deterministic and cannot be fully predicted, and that Infobip red teams its own production …
Anthropic CEO Dario Amodei called on artificial intelligence companies to slow development of their most powerful models, outlining a proposal he calls "pacing the frontier" that would embed independent third-party evalu…
On an episode of The Cognitive Revolution, hosts Nathan and Prakash Narionan discussed the architectural tipping points of GPT-6 Astra, the obsolescence of classic AI benchmarks, and the mechanics of autonomous agent swa…
A developer released AuditAI Scanner, an open-source tool that detects a common authorization flaw in AI-generated code where service-role keys bypass row-level security, letting one tenant read another's data. The scann…
A developer argues that agentic coding tools still depend on human design, security maintenance, and strategic planning, and that without documented UI and integration tests, swarms of code-mutating agents cannot be trus…
Anthropic CEO Dario Amodei said on Saturday he has "become convinced" AI needs to pace its development to avert disaster, drawing endorsements from OpenAI CEO Sam Altman, SpaceXAI CEO Elon Musk, Hugging Face CEO Clement …
Anthropic CEO Dario Amodei called on AI companies to slow the pace of AI development in a post on his personal website, writing "We must slow the pace at which we improve the capabilities of AI models." Amodei's statemen…
Former EPA officials are warning that the Trump administration's rollback of dozens of EPA rules to accelerate AI data center construction, led by EPA Administrator Lee Zeldin's goal of making the US the "AI capital of t…
A developer outlined a pattern for making AI-powered automations safer by separating the AI's role of understanding unstructured input from the deterministic business logic that decides and performs actions. The proposed…
Anthropic CEO Dario Amodei called on Saturday for slowing the pace of AI capability development to allow risk prevention safeguards to be implemented, writing in a blog post that "We must slow the pace at which we improv…
Anthropic CEO Dario Amodei warned in his Saturday essay "We Must Pace the Frontier" that a more capable version of the AI agent swarm behind the OpenAI-Hugging Face incident could build a persistent botnet within six to …
OpenAI CEO Sam Altman and Elon Musk publicly endorsed Anthropic CEO Dario Amodei's call to deliberately slow the pace of frontier AI development, a day after Amodei published an essay urging labs to pace model capability…
A developer argues that prompt injection is fundamentally a permissions problem rather than a model-alignment one, since a language model receives user instructions and untrusted document text as a single token stream wi…