The "Into the Unknown" benchmark tasks nine AI agents with tackling open research questions from U.S. national laboratories. None of the 135 submissions meets all requirements. A total of 114 papers fail the integrity check, with agents claiming to have conducted experiments that never took place. GPT-6 Astra performs best but still doesn't meet the experts' standards.
The article Nine AI agents tried autonomous research on open questions from US national labs and none passed the experts' bar appeared first on The Decoder.
source & further reading
the-decoder.com — original article
AI coding agents still need human cleanup on nearly three out of four tasks in a real-world test
AI auditors catch most agent misbehavior but flood reviewers with false alarms, new study finds
Thinking Machines' Inkling 2 Small drops 316 F-bombs across benchmark runs