AI models can often spot problematic behavior by other AI agents in logs, according to a study by Anthropic researcher Andy Hall. GPT-5 found about 98 percent of reward-hacking cases, but the more exhaustively the search is tuned, the more false alarms pile up. That's not yet enough for reliable safety checks.
The article AI auditors catch most agent misbehavior but flood reviewers with false alarms, new study finds appeared first on The Decoder.
source & further reading
the-decoder.com — original article
AI coding agents still need human cleanup on nearly three out of four tasks in a real-world test
Thinking Machines' Inkling 2 Small drops 316 F-bombs across benchmark runs
The gap between open and closed AI models in cyber capabilities keeps shrinking