Freeze a Holdout Before You Quote a Coding-Agent Score
A developer has published a protocol for scoring coding agents that requires freezing a holdout task suite before any prompt or tool tuning, arguing that pass rates published after iterating on the same tasks are fitted …