Will the Judge Flip? Predicting Position-Sensitive LLM Judgments from Residual Stream Activations
Linear probes on residual stream activations recorded immediately before an LLM judge's initial verdict can predict whether that verdict will flip when candidate responses are reordered, according to an arXiv paper (2610…