{"slug": "astra-held-its-ground-truth", "title": "Astra Held Its Ground (Truth)", "summary": "A new benchmark, TheoPhysEval, comprises 50 unpublished research-level theoretical physics problems with verifiable answers, each solvable by a world expert in about a day or less but taking considerably longer for experts in adjacent specialties, and it was used to test off-the-shelf AI agents. The benchmark was described in a post on Marginal REVOLUTION titled \"Astra Held Its Ground (Truth)\".", "body_md": "TheoPhysEval: We present a suite of 50 unpublished research-level theoretical physics problems with verifiable answers. Without AI assistance, a typical problem in our collection could be solved by a world expert in about a day or less but would take considerably longer for experts in adjacent specialties. We test the ability of off-the-shelf AI agents […]\n\nThe post [Astra Held Its Ground (Truth)](https://marginalrevolution.com/marginalrevolution/2026/10/astra-held-its-ground-truth.html) appeared first on [Marginal REVOLUTION](https://marginalrevolution.com).", "url": "https://wpnews.pro/news/astra-held-its-ground-truth", "canonical_source": "https://marginalrevolution.com/marginalrevolution/2026/10/astra-held-its-ground-truth.html?utm_source=rss&utm_medium=rss&utm_campaign=astra-held-its-ground-truth", "published_at": "2026-10-15 11:18:46+00:00", "updated_at": "2026-10-15 11:48:05.389570+00:00", "lang": "en", "topics": ["ai-research", "artificial-intelligence", "large-language-models", "ai-agents"], "entities": ["TheoPhysEval", "Marginal REVOLUTION", "Astra"], "also_reported_by": [], "alternates": {"html": "https://wpnews.pro/news/astra-held-its-ground-truth", "markdown": "https://wpnews.pro/news/astra-held-its-ground-truth.md", "text": "https://wpnews.pro/news/astra-held-its-ground-truth.txt", "jsonld": "https://wpnews.pro/news/astra-held-its-ground-truth.jsonld"}}