cd /news/artificial-intelligence/show-hn-an-ai-office-work-benchmark-… · home › topics › artificial-intelligence › article
[ARTICLE · art-87290] src=github.com ↗ pub= topic=artificial-intelligence verified=true sentiment=· neutral

Show HN: An AI office-work benchmark, and 4 bugs we found in our own judge

A developer released an AI office-work benchmark and found four bugs in its own evaluation judge, highlighting challenges in measuring AI performance on real-world tasks. The benchmark, posted on Hacker News, aims to assess AI agents on office-related activities, but the self-identified flaws raise questions about the reliability of such evaluations.

read1 min views1 publishedAug 5, 2026
Show HN: An AI office-work benchmark, and 4 bugs we found in our own judge
Image: source

Skip to content Navigation Menu Appearance settings Platform AI CODE CREATION GitHub Copilot Write better code with AI GitHub Copilot app Direct agents from issue to merge MCP Registry Integrate external tools DEVELOPER WORKFLOWS Actions Automate any workflow Codespaces Instant dev environments Issues Plan and track work Code Review Manage code changes Code Quality Enforce quality at merge APPLICATION SECURITY GitHub Advanced Security Find and fix vulnerabilities Code security Secure your code as you build Secret protection Stop leaks before they start EXPLORE Why GitHub Documentation Blog Changelog Marketplace View all features Solutions BY COMPANY SIZE Enterprises Small and medium teams Startups Nonprofits BY USE CASE App Modernization DevSecOps DevOps CI/CD View all use cases BY INDUSTRY Healthcare Financial services Manufacturing Government View all industries View all solutions Resources EXPLORE BY TOPIC AI Software Development DevOps Security View all topics EXPLORE BY TYPE Customer stories Events & webinars Ebooks & reports Business insights GitHub Skills SUPPORT & SERVICES Documentation Customer support Community forum Trust center Partners View all resources Open Source COMMUNITY GitHub Sponsors Fund open source developers PROGRAMS Security Lab Maintainer Community Accelerator GitHub Stars Archive Program REPOSITORIES Topics Trending Collections Enterprise ENTERPRISE SOLUTIONS Enterprise platform AI-powered developer platform AVAILABLE ADD-ONS GitHub Advanced Security Enterprise-grade security features Copilot for Business Enterprise-grade AI features Premium Support Enterprise-grade 24/7 support Pricing Type / to search Sign up Appearance settings You signed in with another tab or window. Reload to refresh your session. You signed out in another tab or window. Reload to refresh your session. You switched accounts on another tab or window. Reload to refresh your session. Dismiss alert {{ message }} Find code, projects, and people on GitHub: Search Contact Support — GitHub Status — @githubstatus You can’t perform that action at this time.

source & further reading
github.com — original article
── more in #artificial-intelligence 4 stories · sorted by recency
── more on @hacker news 3 stories trending now
sponsored brought to you by zahid.host 4,200+ EU-deployed projects
reading about agents? ship yours in a single git push.

Run your AI side-project on zahid.host

EU-based hosting, git-push deploys, automatic HTTPS, no cold starts. Free tier with a custom domain — perfect for shipping the agent you just read about.

$git push zahid main
→ Live at https://your-agent.zahid.host ✓
Get free account → Pricing
from €0/mo · no card required
LIVE [news/show-hn-an-ai-office…] indexed:0 read:1min 2026-08-05 · —