Rater State Bias in RLHF Preference Data: An Audit Framework
Researchers from arXiv identify a structured confound in Reinforcement Learning from Human Feedback (RLHF) where pairwise preference labels may reflect the rater's state during annotation rather than just output quality,…