What Should We Remove? Evaluating the Reliability and Costs of RLVR Data Decontamination
An audit of sixteen open RLVR math corpora covering 1,673,514 training items against six benchmarks with 1,949 questions found that at a cosine threshold of 0.80, 52 of 59 sampled removals (88%) were confirmed false remo…