21:43
2026-07-10
dev.to
artificial-intelligence
Devin, the "First AI Software Engineer," Failed 86% of Its Benchmark Tasks, and Then What
Cognition Labs launched Devin, the 'first AI software engineer,' in March 2024 with a benchmark score of 13.86% on SWE-bench, but independent evaluations later showed it failed 14 out of 20 real tasks…