CloudOpsBench: Claude Fable 5.1 finished 29 of 45 real AWS ops tasks, GPT-6 Astra 26
CloudOpsBench v1.0, a new benchmark of 45 real AWS DevOps tasks, found that Claude Fable 5.1 completed 29 of the 45 tasks and GPT-6 Astra completed 26, with roughly 80% of failures traced to reasoning gaps rather than mi…