cd /news/artificial-intelligence/benchmarks-disagree-on-gpt-6-astra-b… · home topics artificial-intelligence article
[ARTICLE · art-121429] src=the-decoder.com ↗ pub= topic=artificial-intelligence verified=true sentiment=· neutral

Benchmarks disagree on GPT-6 Astra, but its human-beating efficiency on ARC-AGI-3 pulls Chollet’s AGI forecast forward

OpenAI's GPT-6 Astra has surpassed average human efficiency on the ARC-AGI-3 benchmark for the first time, prompting ARC Prize chief François Chollet to move up his AGI forecast, though he stops short of calling it proof of AGI. Benchmark results are mixed: Epoch AI scores Astra at 169 points, while Artificial Analysis rates it no better than its predecessor and behind Claude Fable 5.1. Chollet said progress is running "twice as fast" as he expected.

read1 min views1 publishedSep 4, 2026

OpenAI's GPT-6 Astra is drawing contradictory benchmark verdicts. Epoch AI puts it out in front with 169 points, while Artificial Analysis rates it no better than its predecessor and behind Claude Fable 5.1. The biggest surprise comes from ARC-AGI-3, where Astra works more efficiently than the average human for the first time. ARC Prize chief François Chollet doesn't call this proof of AGI, but he does see the progress running "twice as fast" as he expected, and he's moving up his AGI forecast.

The article Benchmarks disagree on GPT-6 Astra, but its human-beating efficiency on ARC-AGI-3 pulls Chollet’s AGI forecast forward appeared first on The Decoder.

── more in #artificial-intelligence 4 stories · sorted by recency
── more on @openai 3 stories trending now
sponsored brought to you by zahid.host 4,200+ EU-deployed projects
reading about agents? ship yours in a single git push.

Run your AI side-project on zahid.host

EU-based hosting, git-push deploys, automatic HTTPS, no cold starts. Free tier with a custom domain — perfect for shipping the agent you just read about.

$git push zahid main
Live at https://your-agent.zahid.host
Get free account → Pricing
from €0/mo · no card required
LIVE [news/benchmarks-disagree-…] indexed:0 read:1min 2026-09-04 ·