RLE-Bench: A Qualifying Exam for Coding Agents as Robot Learning Engineers

RLE-Bench has been introduced as a qualifying exam that evaluates coding agents as robot learning engineers, according to the benchmark's announcement. Existing robotics benchmarks primarily focus on the performance of individual artifacts such as policies or controllers, leaving limited coverage of coding agents. The benchmark targets the gap between digital coding agents and physical-world robotics challenges.

Coding agents are beginning to move beyond purely digital tasks to tackle physical-world challenges, particularly in robotics. Existing robotics benchmarks, however, primarily focus on the performance of individual artifacts, such as policies or controllers, offering limited coverage of coding agent