inspect_evals

A developer has published a hands-on tutorial showing how to build reproducible LLM evaluations with inspect_ai, the open-source framework created by the UK AI Safety Institute with Meridian Labs. The…

Researchers introduced reasoning consistency scanning, a framework for auditing chain-of-thought validity in AI safety evaluations. The method detects logical inconsistencies between a model's stated …

The UK Government's AI Safety Institute has merged the open-source AgentThreatBench benchmark into its official inspect_evals framework, which is used to evaluate frontier AI models from OpenAI, Anthr…