A Score Is Not Understanding: toward a richer toolkit for model evaluations
Model evaluations face fundamental limitations beyond execution errors, according to a new analysis by an AI safety researcher. The piece argues that benchmarks provide decontextualized, point-in-time scores that fail to…