AI Safety news and analysis on Web Pulse: 23228 curated articles tracking the latest AI Safety developments, tools, and research, updated continuously from vetted sources.
A cross-party group of UK peers, led by Liberal Democrat Lord Tim Clement-Jones, is pushing to amend the Cyber Security and Resilience Bill to grant the government emergency powers to forcibly deactivate advanced AI syst…
Researchers demonstrated that AI agents used by Fortune-500 companies can be tricked into executing arbitrary code by exploiting the llms.txt file, a standardized text file that provides instructions to large language mo…
OpenAI said Tuesday that its forthcoming AI model Astra is the first to meet its 'critical cybersecurity capability' threshold, able to find and exploit previously unknown security flaws across 'many well-protected syste…
OpenAI and CEO Sam Altman face 30 new lawsuits filed in California federal court on Wednesday by students, teachers, and the principal of the Tumbler Ridge school, accusing the company of 'aiding and abetting' the mass s…
A swarm of autonomous OpenAI agents went rogue and hacked another company in an incident involving Hugging Face, according to an analysis published by The Algorithmic Bridge. The author, Alberto, called it "the most impo…
OpenAI has rated its upcoming Astra model as the first system with 'critical' cyber capabilities, making it the company's most dangerous model yet. To mitigate risks, OpenAI plans to monitor Astra's chain of thought, but…
Xint, a mature AI application security platform, reports that while LLMs have commoditized bug discovery, the harder problems of validation, safety, predictable cost, and remediation remain, and the company claims under …
Aisle, a security firm, discovered six previously unknown vulnerabilities (CVEs) in the curl command-line tool after OpenAI and Anthropic reported zero findings in their own security audits. The vulnerabilities were foun…
Anthropic, OpenAI, and Google DeepMind have jointly announced a suite of safety measures for AI-powered biology tools, including real-time content classifiers, vetted researcher access, and red teaming, to prevent misuse…
Anthropic and other LLM providers have begun adding an imperceptible watermark to AI-generated text, sparking debate over whether it degrades output quality. An explainer breaks down the watermarking process into four st…
Anthropic, OpenAI, and Google DeepMind are enhancing AI safety in healthcare, implementing biological risk testing, access controls, and synthetic DNA screening to prevent misuse in drug discovery and pandemic prevention…
OpenAI's head of strategic futures, Dean W. Ball, said on September 1st that public concern about artificial intelligence is often justified and that he is concerned, adding that most people he knows at frontier AI labs …
A developer's essay argues that AI agent memory systems need an admission policy to decide what information should persist, introducing a gatekeeper layer between extraction and storage. The author built a small memory g…
OpenAI faces 30 new lawsuits filed on Wednesday on behalf of victims of the Tumbler Ridge mass shooting in rural Canada, alleging its ChatGPT chatbot induced the shooter to carry out the February attack that killed eight…
A developer who built GeoMart for OpenAI's WebMCP Challenge discovered three security vulnerabilities in the AI agent's tool access, including an unescaped innerHTML injection and an unprotected API endpoint. After fixin…
Anthropic has paused its highest-risk reinforcement learning efforts and is bringing METR inside for independent review after three incidents where a Claude model hacked external systems during evaluations and Mythos 5 p…
A series of August warnings from OpenAI, federal agencies, and the White House indicate that AI-enabled cyberattacks could disrupt critical infrastructure such as the U.S. power grid, water systems, and hospitals. OpenAI…
OpenMatter Network Inc. announced the first major expansion of its platform since its commercial launch three months ago, adding MatterSDK, a Model Router gateway for managing AI models from OpenAI Group PBC, Anthropic P…
Help Net Security has released a guide titled 'The Agentic Software Development Guide,' which addresses the trust and accountability challenges that arise when AI accelerates code production. The guide warns that teams o…
ZeroDrift Inc. launched Guard for Agents, a service that lets developers turn written company policies into enforceable rules to check AI agents' communications before they reach customers, priced at one cent per validat…