inspect_evals

Researchers introduced reasoning consistency scanning, a framework for auditing chain-of-thought validity in AI safety evaluations. The method detects logical inconsistencies between a model's stated …

The UK Government's AI Safety Institute has merged the open-source AgentThreatBench benchmark into its official inspect_evals framework, which is used to evaluate frontier AI models from OpenAI, Anthr…