GSM1k

A developer examined the phenomenon of "benchmaxing" — optimizing models or selectively reporting results to maximize evaluation scores — after finding that Anthropic's Opus 5 scored higher on benchma…

A new essay by an unnamed author argues that benchmark contamination—where AI models have already seen test questions or their answers during training—undermines the validity of many AI benchmarks, pa…