BenchDrift

IBM Research has introduced BenchDrift, an open-source tool that quantifies how much large language model benchmark scores shift when test prompts are rephrased without changing meaning, revealing tha…

A new study introducing BenchDrift shows that rephrasing benchmark problems while keeping meaning and answer fixed flips LLM correctness in both directions across eight models and three benchmarks (GS…