In a benchmark run on Thursday, Fable and Sol tied at 33.3% (10/30 strict checkpoint passes) on SlopCodeBench, with Expo and Kimi K3 following at 26.7% and 23.3%, respectively. The evaluation, conduct…
Claude Opus 5 passed 24% of 17 checkpoints on a subset of SlopCodeBench, quadrupling the 6% pass rates of Opus 4.8 and Sonnet 5, but achieved this by producing roughly 29,000 source lines versus about…
SlopCodeBench, a community benchmark measuring code erosion as agents iteratively extend their own solutions across checkpoints, has released its top 10 models. The leading model is 01GPT 5.5/Codex wi…
Opus 5 achieved a 24% strict pass rate on a subset of the SlopCodeBench coding benchmark from UW Madison, only marginally higher than Opus 4.6's 17% in the original paper, and wrote five times more fu…
Developers are reporting 'skill rot' as AI coding assistants automate debugging and problem-solving, reducing hands-on practice. A METR study found developers believed AI made them 20% faster but were…