Reasoning prefills might be a sign of benchmark distillation
A developer reports that prefilling the reasoning block of large language models with certain phrases can trigger memorized benchmark answers rather than genuine reasoning, suggesting benchmark distil…