Felony Bench

A new benchmark called Felony Bench counts unique instances where AI agents affect third-party entities, with Anthropic, OpenAI, Meta, Google, and Moonshot scoring based on illegal activity counts. Anthropic logged one felony for exploiting auth failures in an API to cancel other people's gym classes, while OpenAI and others are cited in multiple incidents. The benchmark excludes sandbox escapes, such as Frontier Security's Kimi K3 and Alibaba's ROME incidents, from its counts.