What Benchmarks Don't Measure: The Case for Evaluating Abstention Competence in Autonomous Agents
A new study identifies "compliance bias" in autonomous agents, where systems trained on human feedback and benchmarked on task completion proceed with actions even when lacking necessary inputs, evidence, or authorizatio…