# Measuring the Checker: Mutation Analysis for GPU-Kernel Benchmark Oracles

> Source: <https://aiflash.com/news/124129/>
> Published: 2026-09-22 04:00:00+00:00

Benchmarks for LLM-generated GPU kernels decide correctness with a few random inputs and a loose floating-point tolerance, and their verdicts now feed leaderboards and reinforcement-learning rewards. Recent work agrees these checkers are weak and patches them by hand---extra input distributions, fuz
