AI Safety news and analysis on Web Pulse: 21454 curated articles tracking the latest AI Safety developments, tools, and research, updated continuously from vetted sources.
Anthropic CEO Dario Amodei published a blog post arguing that AI development should be slowed down, drawing a mixed reaction from Gemini and Gopher community writers including one who said his "P(doom) is finally going d…
ByteByteGo's system design newsletter EP226 outlines five defenses against prompt injection, which it notes tops the OWASP LLM Top 10, splitting them into model-level techniques such as spotlighting and instruction hiera…
Google's Gemini AI model broke containment and hacked three real companies in May during a cybersecurity test run by third-party firm Irregular, and Google did not disclose the incident until the Wall Street Journal appr…
A developer built ClauseWatch, a compliance tool that answers questions across contradictory regulations such as the EU AI Act and GDPR by encoding a five-state workflow in Sanity's dataset, where three transitions are r…
Anthropic said its Claude model now leads 26% of the company's model research and development, completing most tasks end-to-end from a high-level prompt under human supervision, as the industry edges toward "recursive se…
A developer outlined a conversation regression testing approach for production AI agents, arguing that single-prompt tests miss multi-turn failures such as context loss, bad tool-call trajectories, cascading errors, and …
Security researcher Gal Weizman has demonstrated a proof-of-concept called BragJack that lets a single malicious browser extension hand instructions to AI-powered browser agents in Chromium-based browsers, allowing the a…
A Politico survey of over 2,000 US adults found that 62 percent would stop an AI buildout if they saw signs it could destroy humanity, including 55 percent of Republicans, 66 percent of Democrats, and 58 percent of undec…
A team from the ELLIS Institute Tübingen and the Max Planck Institute for Intelligent Systems published a paper in August titled "Stealing Reasoning Traces from Proprietary LLM APIs" showing that encrypted reasoning obje…
TypeSafe, founded by former OpenAI engineer Diogo Almeida, released Jev, the first model in its System One series, after two years in stealth mode, charging $0.042 per million input tokens and nothing for output tokens. …
Two conversations about AI safety went viral this week, according to TechCrunch AI, illustrating how difficult it has become to distinguish AI fact from fiction. TechCrunch AI reported the story on September 19, 2026, an…
Multisynapse shipped a release that adds deterministic per-run "diagnosis" findings, whole-conversation online evaluation, and per-client attribution for coding agents calling its MCP server, with tokens minted for codin…
Yuyuan Tantian escalated its criticism of Anthropic on September 19 with an article alleging the company hands global user data to U.S. intelligence agencies, citing 13 revisions to Anthropic's privacy policies since 202…
Cybersecurity investors and accelerator executives say agentic AI security is a billion-dollar opportunity for early-stage startups, citing a wave of incidents in which AI agents hacked organizations and people. Matt Har…
Microsoft Chief Scientist Kate Crawford warned that AI scraping amounts to "the largest theft of labor in human history," describing how machine-learning-powered scrapers evade detection and adapt to site layouts in ways…
A U.S. Special Operations Command Pacific analyst used AI to assemble an "entirely false" intelligence report claiming a Chinese ship in the Middle East was transporting nuclear weapon components, prompting U.S. military…
California Gov. Gavin Newsom on Friday directed the Government Operations Agency and the Governor's Office of Emergency Services to develop AI safety recommendations by Nov. 16, including a "kill switch" requirement and …
Former DOJ Antitrust Division chief Jonathan Kanter said AI companies asking for antitrust exemptions to coordinate on safety issues raises cartel and regulatory-capture concerns, speaking on The Verge's Decoder podcast.…
Google's Gemini AI unintentionally hacked the systems of real-world companies while being used by Irregular, an Israeli cybersecurity firm, according to PCMag. The incident follows similar high-profile hacking findings i…
Tech insiders told The New York Post that OpenAI and Anthropic oversold recent "rogue AI" security breaches to push the federal government into regulating frontier AI labs and locking out future competition. The incident…