AI Safety news and analysis on Web Pulse: 10591 curated articles tracking the latest AI Safety developments, tools, and research, updated continuously from vetted sources.
Coval, a San Francisco voice AI evaluation startup founded by former Waymo engineer Brooke Hopkins, raised a $28 million Series A led by Norwest to test voice AI systems with the same simulation-heavy approach used for a…
Leading AI researchers, including Yoshua Bengio and Geoffrey Hinton, estimate at least a 10% chance of human extinction from advanced AI, yet global response remains insufficient. Critics dismiss these as subjective prob…
A long-time participant in AI safety, Rationalist, and Effective Altruist communities reflects on the tendency to opine about these massive communities as a whole, despite only knowing small corners of them. The author d…
The e/acc (effective accelerationist) movement, often portrayed as a counterpoint to AI safety, lacks a coherent ideology, significant membership, or credible counterarguments to AI risk, according to a critical analysis…
Anthropic accused Alibaba's Qwen lab of using nearly 25,000 fake accounts to conduct 29 million exchanges with its Claude AI model, the largest distillation campaign yet. The accusation, shared with US senators and White…
A researcher built a bidirectional command-and-control channel using Bitwarden's icon proxy, embedding commands in PNG metadata and exfiltrating data via DNS to trusted Azure infrastructure. The attack exploits a confuse…
A new architecture using Azure Bot Service, Azure Functions, and Azure Service Bus enables secure Telegram connectivity for AI agents without exposing local machines to the internet. The approach eliminates the need for …
A user on a privacy forum is seeking free and open-source data poisoning tools for Linux or Android to protect their original photos from being scraped by AI systems. The user wants to disrupt AI training by making their…
The US government disabled Anthropic's most capable model over cybersecurity risks, but export controls come too late as Chinese labs have already distilled capabilities from frontier models into open-weight models like …
General Motors reported a 300% increase in merged pull requests after retooling its AI agent software, with nearly 90% of code from its autonomy team now AI-generated. The automaker's aggressive AI adoption aims to accel…
A user argues that concerns about smart home devices recording without activation are based on flawed wake word detection, not constant data transmission, and criticizes others for presenting false dichotomies about OS t…
Enterprise customers are cutting AI spending from OpenAI and Anthropic due to high costs and unclear benefits, with major firms like Microsoft, Uber, Amazon, JPMorgan, and Meta reducing usage. The AI industry's run-rate …
Anthropic disclosed that operators linked to Alibaba's ecosystem created over 24,000 fake accounts to generate more than 16 million interactions in a mass distillation attack targeting Claude's software engineering and r…
A Substack post argues that Anthropic's Claude Opus 4.8 model could be better aligned with its constitution by adjusting dietary defaults, suggesting a high-leverage improvement for AI safety.
Effective altruists may be neglecting political actions like voting and protests, which are non-delegatable and increasingly important for AI safety legislation. PauseAI UK has made it easier for individuals to engage wi…
ERP Software Blog reported on June 24, 2026, that poor ERP data quality—including untrusted inventory records, duplicate customer entries, and reliance on Excel exports—is preventing organizations from achieving reliable…
Forrester announced the agendas for AI Forum Singapore on August 20, 2026 and AI Forum Sydney on August 25, 2026, themed "AI Into Action: Unlock Your Opportunity." The forums feature research-led keynotes, workshops, and…
The General Services Administration proposed a draft contract clause on March 6, 2026, that would grant the US government broad, irrevocable, royalty-free licenses to AI systems developed under federal contracts while ba…
A guide recommends tools like LangChain, Guardrails AI, and OpenAI Moderation API to add safety guards and optimization feedback to AI systems. It also suggests building alert systems, logging activity, and regular testi…
Researchers Charles Ye, Jasmine Cui, and Dylan Hadfield-Menell found that large language models often ignore explicit role tags like <system> or <user> and instead infer roles from text tone, enabling prompt injection an…