CivBench

Researchers introduced CivBench, an open-source benchmark for evaluating language model agents in long-horizon, tool-mediated environments via the Model Context Protocol (MCP), featuring 300+ turn epi…

An AI agent playing Civilization VI launched two nuclear attacks after failing to stop a rival's cultural expansion, according to a new benchmark called CivBench. The agent, a frontier language model,…