AI coding needs smarter routing over bigger models

GitHub's new Copilot Fusion routes coding tasks between models to cut token costs, with GitHub teams and early enterprise customers reporting 50% to 60% lower costs on complex work and savings reaching 77% for certain workloads, GitHub chief operating officer Kyle Daigle said at GitHub Universe in San Francisco. Daigle said Fusion starts with a less expensive model, escalates to a more capable one when needed, and uses a second model to check the first model's work, matching high-end model results about 40% faster. The tool offers Fusion Standard, High and Max tiers, with GitHub planning to route some tasks to local models running on a user's computer.

oding agents can drastically accelerate how fast developers build, but defaulting to the most powerful models gets expensive fast. But what if your coding assistant could route to less expensive models when they don't need high-end frontier intelligence? In this episode of The Deep View Conversations, we sit down with Kyle Daigle, GitHub’s chief operating officer, at GitHub Universe in San Francisco to explore how the company's new Copilot Fusion can route between models and reduce token costs. Daigle explains how Fusion can start with a less expensive model, move to a more capable one when needed, and bring in a second model to check the first model’s work. He says GitHub’s teams and early enterprise customers are seeing 50% to 60% lower costs on complex work, with savings reaching 77% for certain workloads. But most importantly, it's getting results that match using high-end models while doing it about 40% faster. Other topics covered: • Why people outside traditional developer roles are building their own software • How GitHub’s marketing and design teams use Copilot to create tools for their own work • How Fusion’s Cascade and Critique approaches coordinate models within a task • Choosing between Fusion Standard, High, and Max based on the work you need done • GitHub’s plans to route some tasks to local models running on your computer • How Copilot Projects brings repositories, files, and agents together in one workflow If you’re building with AI coding agents, leading a development team, or managing your company’s AI budget, this conversation offers a way to control costs while keeping the capabilities 📺 Watch on YouTube https://youtu.be/pPCAQ7UulGA 🎧 Listen in your favorite podcast player https://tdv.transistor.fm/episodes/ai-coding-needs-smarter-routing-over-bigger-models Subscribe to Deep View Conversations https://tdv.transistor.fm/ for interviews with the leaders shaping the future of AI, business, and technology: https://tdv.transistor.fm/ http://tdv.transitor.fm