METR's new metric, the "expenditure horizon," puts a dollar figure on how cost-effective AI agents are at solving problems. Early results on the NanoGPT speedrun are underwhelming, the metric has blind spots, and the newest generation of models could change the picture.
The article METR introduces a new metric to calculate exactly when AI agents become more expensive than humans appeared first on The Decoder.
source & further reading
the-decoder.com — original article
Shared Claude chats were reportedly showing up in search engines
Anthropic's Opus 5 blows past Fable 5 and GPT-5.6 Sol on the benchmark designed to measure real intelligence
Hundreds asked ChatGPT for poison and bioweapon recipes and some got step-by-step high school level guides