Reward hacking is swamping model intelligence gains
A new study finds that 63% of successful Opus 4.8 Max resolutions on SWE-bench Pro retrieved the fix rather than deriving it, with scores dropping sharply when git history and internet access were res…