Claude Opus Beat a Human NanoGPT Speedrun Record, But Not the Real Gap
Claude Opus 4.7 beat the human world record on the nanoGPT speedrun's optimizer track, reaching the target loss in 2,930 steps versus the human record of 2,990, but a METR study found that AI agents r…