A benchmark called CrossSWE has been introduced to test coding agents on joint development tasks spanning multiple interdependent repositories, addressing a gap the authors say existing software engineering benchmarks miss because real-world development often crosses repository boundaries. The benchmark targets the growing class of coding agents whose success rates on current software engineering benchmarks have risen steadily, with prior efforts increasing task complexity through longer horizons and more extensive code modifications.
As coding agents achieve increasingly high success rates on software engineering benchmarks, recent efforts have sought to increase task complexity through longer horizons and more extensive code modifications. However, real-world software development often spans multiple interdependent repositories
EU-based hosting, git-push deploys, automatic HTTPS, no cold starts. Free tier with a custom domain — perfect for shipping the agent you just read about.