AI Safety news and analysis on Web Pulse: 12235 curated articles tracking the latest AI Safety developments, tools, and research, updated continuously from vetted sources.
Researchers have developed a method called Emergent Alignment that enables large language models to self-correct unethical outputs by adding a conscience step and using Direct Preference Optimization. The technique works…
A decade of research on AI and systems engineering has evolved through three phases, culminating in a human-AI agreement study that identified five critical gaps in AI adoption, assurance, and workforce transformation. T…
Researchers introduced Free-Energy Signatures (Fes), a spectral descriptor for hallucination detection in large language models that treats attention Laplacians as Hamiltonians to extract thermodynamic potentials. The me…
A developer built a safe, local AI coding agent using Node.js and the Mistral LLM on Ollama. The agent runs entirely on the user's machine without any paid subscriptions, inspecting files and returning patch proposals fo…
Shanti Infosoft argues that placing human checkpoints in AI agent workflows is a business decision, not a technical one. The company recommends a 'draft and approve' pattern initially, using reversibility to determine wh…
A developer built an Agent Profiler that functions as an 'adversity sandbox' to stress-test AI agents by injecting transient runtime errors, lazy-agent traps, and structural AST validation. The tool is designed to ensure…
Anthropic proposed collaborating with the Trump administration on June 18, 2026, to resolve cybersecurity concerns and lift a US ban on its advanced AI models Mythos 5 and Fable 5. The ban, imposed on June 12-13, suspend…
On June 12, 2026, the US government forced Anthropic to take its Claude Fable 5 AI model offline via export controls, citing a jailbreak that revealed minor vulnerabilities. The White House demands jailbreak-proof guardr…
A developer built an open-source PII firewall for LLMs after accidentally sending a customer's credit card number to OpenAI during a benchmark test. The tool, called LLM Governance Engine, intercepts prompts before they …
IT Security News reports a new exploit chain called AutoJack that converts AI browsing agents into remote code execution vectors by abusing trust in localhost, missing authentication, and unsafe parameter handling to tar…
Sebastian Mallaby, author of The Infinity Machine, discusses insights from over 100 AI insiders on the race to superintelligence, the culture of AI, and early breakthrough detection in an interview on The Tim Ferriss Sho…
A new protocol-level defense against tool poisoning in the Model Context Protocol (MCP) has been proposed, using signed tool manifests to detect unauthorized changes to tool descriptions between approval and reconnect. T…
A developer argues that hallucination detection in AI agents is an instrumentation problem, not a model-quality issue, and introduces a layered detection approach using AgentLens and agent-eval tools. The technique invol…
A startup has built the first AI runtime that enables models to shift behavior by reading the moment, addressing issues like drift, tone mismatch, and slop outputs by providing runtime insights into social norms and conv…
Enterprise AI governance requires a context control plane beneath every model request, not optional tool calls that models can choose to invoke. Tenure introduces such a plane, starting with governed memory and state, to…
A Pentagon court filing confirms xAI's Grok Gov Model was integrated into U.S. targeting systems during Operation Epic Fury in Iran, helping deploy over 2,000 munitions in 96 hours. The admission raises urgent questions …
The Department of Justice intervened in a Clean Air Act lawsuit against Elon Musk's xAI, arguing that the company's Grok chatbot is vital to national security and should not be hindered by pollution penalties. The suit, …
Amazon CEO Andy Jassy alerted Treasury Secretary Scott Bessent about a jailbreak vulnerability in Anthropic's Fable 5 AI model, triggering Trump administration export controls that forced Anthropic to pull its most power…
Clioloop's Agentic Fusion pipeline uses multiple AI models with strict security boundaries to improve quality and safety. Planners and reviewers are read-only, while only the main model has tool access, enabling frontier…
Drydock, a new open-source tool, runs autonomous coding agents like Claude Code and OpenAI Codex in hardware-isolated VMs on macOS, preventing compromised agents from accessing API keys, filesystems, or the internet. The…