Anchoring Bias in LLM-as-a-Judge Systems: Prior Scores Compromise Evaluation Independence
A new arXiv study (2608.25869v1) finds that prior scores anchor LLM-as-a-Judge systems, shifting ratings toward those values across 192,000 attempted evaluations (185,271 successful), with seven of eight models showing 9…