Astra Held Its Ground (Truth)

A new benchmark, TheoPhysEval, comprises 50 unpublished research-level theoretical physics problems with verifiable answers, each solvable by a world expert in about a day or less but taking considerably longer for experts in adjacent specialties, and it was used to test off-the-shelf AI agents. The benchmark was described in a post on Marginal REVOLUTION titled "Astra Held Its Ground (Truth)".

TheoPhysEval: We present a suite of 50 unpublished research-level theoretical physics problems with verifiable answers. Without AI assistance, a typical problem in our collection could be solved by a world expert in about a day or less but would take considerably longer for experts in adjacent specialties. We test the ability of off-the-shelf AI agents … The post Astra Held Its Ground Truth https://marginalrevolution.com/marginalrevolution/2026/10/astra-held-its-ground-truth.html appeared first on Marginal REVOLUTION https://marginalrevolution.com .