{"slug": "scaling-ai-agents-what-we-learned-from-9-real-world-cases", "title": "Scaling AI Agents: What We Learned From 9 Real-World Cases", "summary": "JetBrains published a report, \"How Top Teams Scale AI Agents,\" documenting nine case studies on how engineering organizations deploy AI coding agents, including Fin's results of 3x pull request throughput, a 54% reduction in its defect backlog, and 50% lower cost per PR over 16 months. The report also cites an organization that reached 95% AI adoption without any gain in developer velocity, and a Skiller Whale customer where a group trained to supervise agents roughly doubled PR throughput while the rest of the organization declined. JetBrains argues that agent scaling depends on fixing the surrounding development workflow — standardized build tools, fast tests, and shared skills, plugins, MCP servers and evaluations — rather than adding more agents.", "body_md": "[Agentic AI](https://blog.jetbrains.com/blog/category/agentic-ai/)\n\n[Best Practices](https://blog.jetbrains.com/blog/category/best-practices/)\n\n[JetBrains Air](https://blog.jetbrains.com/blog/category/jetbrains-air/)\n\n# Scaling AI Agents: What We Learned From 9 Real-World Cases\n\n*Our brand-new report explores what it takes for software development leaders to put agents to work.*\n\nOne organization reached 95% AI adoption without seeing an improvement in developer velocity. Another tripled its pull request throughput while reducing its defect backlog by 54%.\n\nWhat explains the difference?\n\nTo find out what makes AI agents effective beyond individual developers, I spoke with engineering leaders and practitioners from Fin, Semrush, Skiller Whale, and other organizations.\n\nThe findings are now available in our new report, [*How Top Teams Scale AI Agents*](https://lp.jetbrains.media/how-top-teams-scale-ai-agents-report/), featuring nine real-world case studies and practitioner accounts, including insights from our own engineering teams at JetBrains.\n\nThe report looks beyond adoption rates and individual productivity gains to explore what actually changes when teams start relying on AI agents – how they organize work, maintain code quality, share knowledge, manage costs, and measure results.\n\nHere are three lessons that stood out to me.\n\n## #1. More agents won’t fix a broken development workflow\n\nAt Fin, the initial goal was to double pull request throughput without compromising code quality, security, or performance.\n\nRather than simply rolling out more coding agents, Fin established a dedicated team, Team 2x, to manage the infrastructure around them, including shared skills, plugins, MCP servers, and evaluations.\n\nThe team tested agent skills against real examples, backtested its code-review skill against historical PRs, and analyzed agent sessions to identify recurring mistakes and missing context.\n\nBut increasing output created new problems. CI came under pressure, and code quality became inconsistent. Fin responded by investing in linting and standardization.\n\nOver 16 months, Fin reported:\n\n- 3× PR throughput\n- 54% reduction in its defect backlog\n- 50% lower cost per PR, despite higher total AI spending\n\nThe especially interesting part is how much work Fin put into making the rest of its engineering system keep up.\n\n## #2. Your codebase needs to be ready for agents\n\nEven capable agents struggle when they can’t reliably build a project, run tests, or find the context they need.\n\nThis is particularly challenging in large, complex repositories, where developers often rely on years of accumulated knowledge about build configurations, dependencies, and project conventions.\n\nAt JetBrains, we’ve been tackling this problem in our own large monorepo. Our experience points to several practical requirements: standardized build tools, fast tests, accessible APIs, and environments that agents can set up themselves.\n\nThe lesson is straightforward: Before investing in more agents, look at what prevents the ones you already have from completing tasks reliably.\n\n## #3. Individual AI adoption doesn’t automatically improve team performance\n\nIn one organization Angie Jones discussed, AI adoption reached 95%, yet developer velocity remained unchanged.\n\nThe team shifted its focus from encouraging AI use to helping developers delegate meaningful work. Champions who built richer repository-level context were eventually opening pull requests at three to four times their previous pace.\n\nSkiller Whale encountered a different version of the same problem. In one customer engagement, a group trained to supervise AI agents roughly doubled its PR throughput, while throughput declined across the rest of the organization.\n\nThese examples highlight something easy to overlook in AI adoption initiatives: Developers need to learn how to structure tasks, provide context, evaluate results, and share effective practices with colleagues. Otherwise, organizations risk ending up with a handful of highly productive AI power users rather than more productive engineering teams.\n\n## What does it take to scale AI agents?\n\nAcross these conversations, one pattern kept emerging: The organizations seeing meaningful results were consistently changing the systems and practices around them.\n\nThat meant making development environments agent-ready, establishing shared standards, improving review processes, investing in team learning, and measuring outcomes beyond adoption.\n\nThere’s no single playbook that works for every engineering organization, but there are concrete approaches worth learning from, including the ones that didn’t work the first time.\n\nTalking to these teams gave me plenty to think about, and I’m sure there are many more stories worth sharing. I’d love to hear about your experiences with AI agents, the lessons you’ve learned, or the challenges you’re still figuring out, in the comments section.\n\n#### Subscribe to JetBrains Blog updates", "url": "https://wpnews.pro/news/scaling-ai-agents-what-we-learned-from-9-real-world-cases", "canonical_source": "https://blog.jetbrains.com/blog/2026/11/13/scaling-ai-agents-what-we-learned-from-9-real-world-cases/", "published_at": "2026-11-13 11:00:13+00:00", "updated_at": "2026-11-13 12:23:01.265127+00:00", "lang": "en", "topics": ["ai-agents", "ai-tools", "developer-tools", "ai-products"], "entities": ["JetBrains", "Fin", "Semrush", "Skiller Whale", "Angie Jones", "Team 2x", "How Top Teams Scale AI Agents"], "also_reported_by": [], "alternates": {"html": "https://wpnews.pro/news/scaling-ai-agents-what-we-learned-from-9-real-world-cases", "markdown": "https://wpnews.pro/news/scaling-ai-agents-what-we-learned-from-9-real-world-cases.md", "text": "https://wpnews.pro/news/scaling-ai-agents-what-we-learned-from-9-real-world-cases.txt", "jsonld": "https://wpnews.pro/news/scaling-ai-agents-what-we-learned-from-9-real-world-cases.jsonld"}}