45 of 45 published models side with the experts, not MMLU-Pro's answer key, on its inherited MMLU errors
Researchers at Munim, Inc., operating as MV2, found that all 45 published models whose prediction archives match the current MMLU-Pro test set chose the MMLU-Redux experts' answer over MMLU-Pro's inherited key on 46 disp…