Reliable and Developer-Aligned Evaluation of Agents for Software Engineering
Researchers propose a new evaluation methodology for LLM-powered software engineering agents, focusing on contamination-awareness, in-the-wild behavior assessment, and trajectory-aware benchmarks to better reflect real-w…