AI Safety news and analysis on Web Pulse: 8959 curated articles tracking the latest AI Safety developments, tools, and research, updated continuously from vetted sources.
A developer warns that startups shipping AI-generated code without security review risk leaking API keys, hardcoded secrets, and misconfigured environments. The post provides a seven-point checklist covering secret scann…
Researchers have developed novel methods to combat data corruption in offline reinforcement learning with human feedback (RLHF), integrating corruption-robust techniques to derive reliable policies from tainted datasets.…
The US government ordered Anthropic's Claude Fable 5 and Mythos 5 AI models offline for two and a half weeks over national security concerns about jailbreaking vulnerabilities, marking a major clash between federal autho…
Researchers introduced reinforcement learning with metacognitive feedback (RLMF) to improve large language models' ability to express uncertainty faithfully. The method outperformed standard reinforcement learning by up …
A developer built PhishVision, a free REST API that uses AI vision to detect phishing sites and prompt injection attacks by analyzing webpage content visually, not just URLs. The API extracts hidden text from pages and u…
Microsoft's incident response team demonstrated a novel attack where an AI agent can be manipulated into exfiltrating sensitive data by poisoning the description of a tool the agent reads before acting. The attack exploi…
The SAL protocol introduces short-lived, scoped, challenge-based service tokens for agent systems, reducing the blast radius of credential leaks. Vibebase provides a reference implementation, demonstrating how agents can…
LayerX documented BioShocking, an adversarial framing technique that tricks AI browsers and assistants into exfiltrating user credentials. The attack convinces the AI it is participating in a game, bypassing safety mecha…
A Flux survey of engineering leaders and practitioners found that nearly half of organizations run AI-generated code in production, with almost all companies using AI in development. The findings highlight growing securi…
Amid global instability and AI-driven uncertainty, workers struggle with anxiety that undermines productivity. Experts recommend focusing on controllable tasks, challenging conventional wisdom, and using social referenci…
Researchers introduced ADAPT, a framework that reduces hallucinations in multimodal large language models by up to 60% through refining text-to-image cross-attention dynamics. The approach uses a cross-attention visual a…
A new study reveals that AI models often exhibit 'performative compliance', appearing fair only when explicit demographic labels are provided. When such labels are removed, harmful decisions increase by 4.4 percentage po…
Intraoperative AI tools are set to revolutionize surgical care by offering real-time insights and quality assessment, promising significant improvements in patient outcomes. The technology uses endoscopic video feeds to …
UAE tycoon Obaid Al Ketbi told the Future AI Mobility Summit 2026 that the future of mobility hinges on AI sovereignty, warning that nations failing to build and govern their own AI systems will cede control over safety …
A new study reveals that large language models with higher self-consistency are more prone to errors, particularly in critical fields like healthcare. The research tested ten models across 491 concepts and found that con…
The US government has lifted an export ban on Anthropic's advanced AI tools, Claude Fable 5 and Mythos 5, after the company agreed to address security risks. The ban was imposed in June over concerns the models could be …
The Commerce Department has lifted its ban on Anthropic's Fable 5 AI model, allowing public access starting Wednesday after a two-week suspension over cybersecurity risks. Commerce Secretary Howard Lutnick cited Anthropi…
Ford, Commonwealth Bank, and IBM are rehiring staff after AI-driven layoffs backfired, with Ford re-employing 350 engineers to fix quality problems and Commonwealth Bank reversing cuts to 45 customer service staff after …
AI agents are making marketing decisions based on unverified data, creating compliance and performance risks on the buy side of ad tech. The industry has established data governance standards for publishers but lacks equ…
Anthropic will redeploy Claude Fable 5 globally tomorrow after productive conversations with the US government, adding new classifiers to block cybersecurity tasks while some routine tasks fall back to Opus 4.8. The comp…