ProgramDistill: From Interactive Web Apps to Verifiable Reference-Guided SWE Tasks
ProgramDistill, a new benchmark for evaluating coding agents, tasks agents with inferring desired behavior from working software and implementing it in an incomplete application, rather than relying on issues or instruct…