Your Queries Can Reorder the Retrieval Leaderboard
A developer's investigation into retrieval leaderboards reveals that rankings are highly sensitive to query wording, meaning models topping benchmarks may not perform best on an application's own data…