Harness Evolution in AI: Are We Overfitting?
A study using Terminal-Bench 2.1 with GPT-5.4 and Claude Opus 4.6 found that automatic harness evolution for LLM agents fails to consistently outperform simpler test-time scaling methods, especially on unseen tasks, rais…