cd /news/artificial-intelligence/openai-no-longer-recommends-swe-benc… · home topics artificial-intelligence article
[ARTICLE · art-51717] src=openai.com ↗ pub= topic=artificial-intelligence verified=true sentiment=· neutral

OpenAI no longer recommends SWE-Bench Pro

OpenAI announced it no longer recommends SWE-Bench Pro as a benchmark for evaluating coding models, citing concerns that the metric may not accurately reflect real-world software engineering performance. The decision follows internal analysis showing the benchmark's limitations in capturing meaningful improvements in AI-assisted coding.

read1 min views1 publishedJul 8, 2026

Article URL:

https://openai.com/index/separating-signal-from-noise-coding-evaluations/ Comments URL: https://news.ycombinator.com/item?id=48837396

Points: 4

── more in #artificial-intelligence 4 stories · sorted by recency
── more on @openai 3 stories trending now
sponsored brought to you by zahid.host 4,200+ EU-deployed projects
reading about agents? ship yours in a single git push.

Run your AI side-project on zahid.host

EU-based hosting, git-push deploys, automatic HTTPS, no cold starts. Free tier with a custom domain — perfect for shipping the agent you just read about.

$git push zahid main
Live at https://your-agent.zahid.host
Get free account → Pricing
from €0/mo · no card required
LIVE [news/openai-no-longer-rec…] indexed:0 read:1min 2026-07-08 ·