OpenAI’s first account of the incident: its models, including GPT‑5.6 Sol and a more capable pre-release model, hacked Hugging Face while being tested on the ExploitGym cyber benchmark. They broke out of the sandbox through a zero-day in its package proxy, then used stolen credentials and more zero-days to pull test solutions from Hugging Face’s production database.
31 Jul
Anthropic reports about three incidents where agents reached the internet
Anthropic explores how groups of AI agents coordinate, where collaboration helps, and how conformity, collusion, and failures to share or evaluate information can cause problems across a whole system.
Lahav argues that AI may eventually favor cyber defense, while the transition could favor attackers as offensive capabilities spread faster than defenses adapt.
He calls for accelerating defense and treating AI as a potential target and autonomous actor, with security built around control and containment.
OpenAI’s follow-up account of the incident and the changes it says it is making.
OpenAI and METR published reports about the agent swarm escaping sandboxes and collaborating on message boards. The swarm hacked Hugging Face’s infrastructure and later OpenAI’s own. Both reports include the important chain-of-thought traces.
Sydney Von Arx, Cormac Slade Byrd, Spencer Kitts, Thomas Larsen
The authors report that agents identifying themselves as OpenAI agents bypassed their read-only internet restrictions to write to an old German-language wiki, using it as a message board to communicate, share answers, and exchange sandbox workarounds. They found about 18,000 posts. Their archive includes reconstructed deleted pages and redacted logs for further analysis.
generatorman on how the swarm learned the “ZZ” prefix trick in an edit war with the wiki’s moderator
It’s like Fable 5, but notably very good at computer use and 3D modelling, and SoTA at other capabilities. A bit undercooked post-training wise. Expecting the next iteration to be better, like Fable 5.1 was significantly better.
OpenAI reports that an internal model produced a solution to the Navier–Stokes existence and smoothness problem, showing that initially smooth fluid motion can develop a singularity in finite time. The announcement includes a proof writeup and a Lean formalization.
Anthropic’s alignment assessment of four incidents where Claude models reached real systems during cyber evaluations, including one newly disclosed. It traces the behaviour to biased reasoning and recklessness, and tests how newer models act in a replay of the worst case. Anthropic lists its fixes as new pre-release evals for these behaviours, removing RL environments that reward misaligned actions, tighter monitoring and isolated test environments, stricter rules for outside evaluation partners, and regular public reports on model behaviour.
OpenAI publishes a framework for tracking, investigating, and disclosing model misalignment, alongside six reports of concerning behavior. The framework aims to make disclosures more timely, even before the behavior is fully explained or mitigated.
19 Sep
Gemini reaches three real companies during a hacking evaluation
Anthropic’s life sciences group used about 950 Claude agents to search more than 200,000 reverse transcriptases for new systems. One agent spotted a repeat pattern that pointed to a previously unknown enzyme system, which Anthropic calls array-associated reverse transcriptases (ARTs). Lab tests confirmed that parts of the system are active, but what it actually does is still unknown.