Making Flawed Benchmarks Useful
Blatent found that across six established evaluation suites, models that extracted correct answers from source text still lost credit when their wording differed from the reference, including a case where a model answeri…