Standard coding-agent benchmarks primarily evaluate binary task success, treating execution as a black box and obscuring the behaviors that produce those outcomes. We analyze a large corpus of 143,209 execution trajectories from 125 agent configurations spanning 117 unique models. To enable comparis
Notes from a 2 AM On-Call: Why Our Stitch MCP Server Died Silently on Tool Timeouts