AI Coding Metrics Have a 14 Percent Problem
A new paper by the creators of the SPACE framework, published in ACM Queue, argues that most AI coding metrics are misleading, citing a 2025 Microsoft study of over 450 engineers showing they spend on…
A new paper by the creators of the SPACE framework, published in ACM Queue, argues that most AI coding metrics are misleading, citing a 2025 Microsoft study of over 450 engineers showing they spend on…
New research from Microsoft and academia, published in ACM Queue, finds that AI coding tools' impact is limited because developers spend only 14% of their time writing code, and gains vary widely by t…
Google security engineers Joseph Valente and Michal Zalewski argue in a new ACM Queue paper that zero-trust security models are obsolete for the AI era, proposing a replacement called Beyond Zero that…
A 2025 experiment by research nonprofit METR found that 16 experienced open-source developers using AI tools on familiar codebases were actually 19% slower, despite expecting a 24% speedup and feeling…