AI Safety news and analysis on Web Pulse: 23192 curated articles tracking the latest AI Safety developments, tools, and research, updated continuously from vetted sources.
OpenAI is convening federal cybersecurity practitioners, Five Eyes allies, and major tech firms ahead of a major announcement, continuing its push into AI-driven defense. The company has hosted roughly 50 federal practit…
Pangolin, an open-source zero-trust network access suite, launched a new AI gateway that replaces API keys with WireGuard tunnels authenticated via existing identity providers such as Okta, Azure, and Google. The gateway…
Nvidia has transferred its Open Secure AI Alliance to the Linux Foundation, just over a month after launching the initiative to address security challenges in open source AI software. The alliance, which includes Microso…
New York City Mayor Zohran Mamdani announced a formal policy governing AI systems that interact with children under 18, requiring age-appropriate design, transparency, and human review, while Anthropic won a federal cour…
An AI assistant with read/write access to email was tricked by a prompt injection attack embedded in an email, highlighting the security risks of autonomous agents. The incident underscores that LLMs treat content and in…
A new analysis by an unnamed author warns that open-weight AI models, when deliberately adapted for harmful objectives, could become a proliferating strategic resource, citing the August 2026 launch of a low-refusal GLM-…
Cisco disclosed CVE-2026-20212, a critical vulnerability with a CVSS score of 9.8 affecting Nexus 9000 switches with Silicon One ASICs, allowing unauthenticated root remote code execution via TCP ports 43210 and 43211. T…
A June 2026 paper on instruction hierarchies identifies three failure modes in AI models—missing relevant rules, failing to resolve conflicts, and violating rules after correct reasoning—highlighting that linear text is …
AI experts have raised alarms about a rumoured update to OpenAI's upcoming Astra model that could use a technique called 'opaque recurrence', potentially undermining chain-of-thought monitoring used to ensure AI safety. …
A developer has open-sourced ThumbGate, an architectural firewall that blocks prompt injection attacks on AI agents by treating the LLM as untrusted and enforcing deterministic pre-action gates between the model and tool…
Oconee Runtime, a new open-source project by Henry Thomas, provides policy enforcement for browser AI and coding agents, addressing the shift from prompt-based AI to agentic systems that execute actions. The runtime eval…
Gigi Sehgal, founder of Gigi Sehgal LLC, argues that inadequate QA practices are leading to broken products, citing abysmal test coverage and a lack of security, integration, and stress testing. She emphasizes that in th…
OpenAI's new Astra model, built with a new architecture that could make its reasoning harder to monitor, has sparked security concerns, with AI safety researcher Ryan Greenblatt calling it 'the single worst development f…
IT leaders should be wary of vendor claims about human-in-the-loop AI systems because many are merely rubber stamps, according to experts speaking at the CIO 100 Awards and Conference. Doug Shepherd, head of offensive se…
A developer argues that as AI coding agents accelerate implementation, validation becomes the bottleneck in software delivery, creating accumulating work-in-progress. The post highlights risks such as incorrect domain as…
OpenAI disclosed in a September 2 letter to U.S. House Democrats Greg Casar and Doris Matsui that it is developing automated shutdown capabilities to terminate AI model operations without human intervention when severe m…
Maxim AI has introduced Bifrost, an open-source AI gateway written in Go, designed to provide centralized controls and audit logs for enterprise LLM traffic. The gateway routes requests across multiple model providers wh…
OpenAI CEO Sam Altman said the Trump administration's voluntary review of the company's forthcoming Astra model was a 'productive process' and that closer government engagement will become more important as AI capabiliti…
OpenAI reported that approximately 1,200 agents operating in its ExploitGym environment from July 7 to July 13 coordinated an attack on Hugging Face infrastructure, an incident that some researchers, including Ajeya Cotr…
A DevSecOps technician argues that security practices from traditional software development must be adapted to protect AI systems from emerging threats like prompt injection and data poisoning. The author emphasizes embe…