{"slug": "is-coding-with-ai-actually-faster-and-cheaper", "title": "Is Coding with AI Actually Faster and Cheaper?", "summary": "A developer's review of research on AI coding productivity finds that autonomous coding agents correlate with a 240% rise in commits but only a 30% increase in software releases, with no overall growth in app usage across the marketplaces studied, according to a September 2026 MIT and Wharton study of more than 500,000 GitHub developers. Task-level results are mixed: Cui et al. in Management Science measured 26.08% more completed tasks, Borg et al. found 30.7% less implementation time, Science estimated a 3.6% quarterly rise in GitHub coding activity, while METR's July 2025 study found developers 19% slower.", "body_md": "How has AI actually changed the way we work? Are coding agents really making us remarkably faster? And what if, instead of answering with “well, that's what I think,” we tried looking at some actual scientific research?\n\nThis is another article inspired by the upcoming AI Coding Summit in Berlin (and yes, I'll leave a link to my speaker badge at the end again, which I think might come with some discounts). I promised myself I wouldn't do this again, but, as usual, I've also signed up for three panel discussions. 😅 One of them has a title very similar to this article.\n\nI wanted some hard data for that discussion, so I dug into the research. You'll find links to all the studies at the end.\n\nAnd since today hasn't exactly been a great day for me, and I'd much rather be somewhere else, I figured I'd cheer myself up the usual way. By writing something for you!\n\nLet's start with the first question. Has AI really made us faster? If someone suddenly stopped me in the street and demanded an answer, I'd probably say yes. In my experience, we write code much faster now.\n\nBut that improvement doesn't seem to translate into an equally dramatic increase in how much software we actually deliver. After all, there's code review, analysis, discussions, and so on and so on. Sure, things are a bit faster. Maybe a little less stressful, too. But I wouldn't say the entire development process has suddenly become much quicker.\n\nThen again, maybe it's just me? Maybe the rest of the world is already shipping features at the speed of light?\n\nWell, apparently not.\n\nA study by economists from MIT and Wharton, revised in September 2026, suggests that my intuition might not be entirely wrong. The researchers analyzed data from more than 500,000 GitHub developers and estimated the following cumulative changes associated with autonomous coding agents:\n\n| Metric | Estimated change | \n|---|---|\n| Coding activity (commits) | **+240%** | \n| Software releases | **+30%** | \n| Total app usage across the marketplaces studied | **No overall increase** | \n\nThese are observational estimates. Still, the gap between the jump in commits and the increase in releases is pretty striking.\n\nOkay, so we're committing a lot more and shipping somewhat more often. In my own work, it sometimes just feels a little less stressful. But it's hardly the revolution some people make it out to be. Maybe things look different in brand-new projects. In large, established systems like the ones I work on, I haven't seen anything close to a tenfold improvement.\n\nMaybe that'll change when someone invents those super-self-healing-autonomous agents. For now, I sometimes feel like things are getting more complicated. With everything that's been happening around AI security lately, everyone seems to be getting a little obsessed with it. Myself very much included. 😅\n\nOkay, we have more commits. But are we actually coding faster? Again, if I had to guess, I'd say yes, but not *that* much faster.\n\nThe data is mixed.\n\n| Study | Result | What was measured | \n|---|---|---|\n| Cui et al., *Management Science* , 2026 | **+26.08%** | Number of completed tasks | \n| METR, July 2025 | **19% slower** | Time to complete tasks | \n| *Science* , January 2026 | **+3.6%** | Estimated increase in quarterly coding activity on GitHub | \n| Borg et al., June 2026 | **30.7% less time** | Median reduction in implementation time in the observational phase | \n\nOnce again, the results are reasonably close to what I expected. I'm not going to spend the next ten paragraphs going over the methodology. If you're curious, the original studies are linked below. They looked at different developers, tools, and tasks, and each percentage measures something different.\n\nSeveral of these studies do point to gains, though. We're not all suddenly 10x developers. xD But there are real improvements.\n\nMETR is the odd one out here. It's from 2025, which, in the current AI world, practically makes it ancient history. But I love one detail about it.\n\nBefore the experiment, developers expected AI to make them about **24% faster**. The actual result? They were **19% slower**! And even after the experiment, they still thought AI had made them faster.\n\nIt shows how much we can fool ourselves until we actually measure things. I swear, this applies to practically every area of life. For example, I used to think I barely ate anything. 😂\n\nTo be fair, METR published an update in February 2026. The researchers think newer tools are likely to be more helpful, but their follow-up couldn't reliably estimate the speedup because of who was willing to participate.\n\nIf someone woke me up at midnight and asked whether AI had made software development cheaper, I'd probably say no. At least not yet.\n\nThe 2025 DORA research and a follow-up published in March 2026 point to something many of us have written about. Some of the time we save writing code goes straight into auditing and verifying it. So the savings on implementation can shrink by the time the change gets to production. DORA describes where that work can shift, leaving the overall cost question open.\n\nYes, yes, I've heard about multi-agent teams where one agent writes the code, another reviews it, another tests it, and then it all goes into production. I'm sure that can work in some situations. I'd be very cautious about trying that trick in a mission-critical system. Financial software, for example. Good luck with that strategy 😂🤞\n\nOne last question. Are we spending all the money we save by writing code faster on tokens?\n\nI have to admit, the answer surprised me! If I had to guess, I'd have said yes, especially if you blindly use the most expensive models for absolutely everything.\n\nBut the findings are more interesting than that! Two recent studies looked at the economics of AI-assisted software development. One was published in September 2026 by Potluri and colleagues, and the other in October 2026 by Steffen Herbold.\n\nBoth suggest that **the effectiveness of an AI agent can matter more than the price of the tokens it consumes.** In Potluri's analysis, models that solved more tasks produced substantial estimated savings, while less effective models ended up costing more in many task categories. A cheap model can get expensive pretty quickly if it keeps failing and you have to pay for another try.\n\nHerbold simulated 432 scenarios for teams using a mix of developers and AI agents. He included salaries, token costs, supervision, bugs, and technical debt. Teams with highly capable agents were usually cheaper than teams of developers working without AI. The results for less capable agents were mixed. In the simulation, **agent capability mattered more than token price** because better results cut the cost of checking and fixing the work.\n\nHerbold's results come from simulations, and Potluri's estimates come from benchmarks and economic modeling. So we have two ways of estimating when the savings might outweigh the token bill. The actual cost of building and maintaining commercial software is a much bigger question.\n\nIt looks like AI really can make coding faster and cheaper. Several studies show gains on specific tasks, and the economic models suggest that capable agents can save money even after you pay for the tokens.\n\nWe still have less evidence about whether the **total cost of building, delivering, securing, and maintaining software** has fallen across the industry.\n\nSo far, the research mostly lines up with what a lot of us seem to feel. Skynet may already be sharpening its weapons, but it hasn't conquered the world just yet. 😅\n\nAnd what about you? Do these findings reflect your experience? Has AI genuinely made your team faster and cheaper, or does it look completely different where you work?\n\nI'd love to hear your thoughts!\n\nIf you enjoyed this article, you can also [follow me on LinkedIn](https://www.linkedin.com/in/sylwia-laskowska-5a8467131/).\n\nAnd if you'd like access to free materials from AI Coding Summit, you can register using [my speaker badge](https://gitnation.com/badges/ai-coding-summit-berlin/sylwia_laskowska_154511).", "url": "https://wpnews.pro/news/is-coding-with-ai-actually-faster-and-cheaper", "canonical_source": "https://dev.to/sylwia-lask/is-coding-with-ai-actually-faster-and-cheaper-2810", "published_at": "2026-11-18 08:32:45+00:00", "updated_at": "2026-11-18 08:43:58.398894+00:00", "lang": "en", "topics": ["artificial-intelligence", "ai-agents", "ai-tools", "developer-tools"], "entities": ["MIT", "Wharton", "GitHub", "METR", "Management Science", "Science", "Borg et al.", "Cui et al."], "also_reported_by": [], "takeaway": "Across studies, coding agents raised commits by an estimated 240% but releases only 30%, while task-level time savings ranged from 30.7% faster to 19% slower depending on the study.", "recommendation": null, "alternates": {"html": "https://wpnews.pro/news/is-coding-with-ai-actually-faster-and-cheaper", "markdown": "https://wpnews.pro/news/is-coding-with-ai-actually-faster-and-cheaper.md", "text": "https://wpnews.pro/news/is-coding-with-ai-actually-faster-and-cheaper.txt", "jsonld": "https://wpnews.pro/news/is-coding-with-ai-actually-faster-and-cheaper.jsonld"}}