{"slug": "ubers-ai-software-factory-cutting-cost-per-session-in-half-at-9-4x-more-agent", "title": "Uber’s AI Software Factory: Cutting Cost Per Session in Half at 9.4x More Agent Requests", "summary": "Uber cut its cost per AI coding agent session by 52% from its June peak while weekly agent requests grew 9.4x and weekly active users grew 7x between February and August 2026, the company's engineering team reported. More than 70% of Uber's pull requests are now attributed to AI agents, and the team reduced cost by decomposing spend into six terms — users, sessions per user, turns per session, requests per turn, tokens per request, and price per token — and attacking the middle three. Uber also routed agent-to-tool connections through a unified MCP gateway covering 1,000+ internal and third-party servers, replacing full schema preloading that added roughly 50,000–70,000 tokens to the first prompt with CLI-resolved tool calls and on-demand tool search, dropping that overhead to near zero.", "body_md": "From February to August 2026, weekly active users on Uber’s AI coding agents grew **7x**. Weekly agent requests grew **9.4x.**\n\n**and what happened to** cost per session? Down **52%** from its June peak.\n\nMost teams see these trends on a regular basis. Usage goes up, the bill goes up with it, and someone in finance starts asking uncomfortable questions in a budget review.\n\n**This article walks through how Uber’s engineering team actually did it, and what parts of the playbook apply even if you are a five-person team, not a company running 30,000+ agent skill executions a day.**\n\n**An interactive coding agent burns tokens differently** depending on who is using it, how long the session runs, how many times it calls a tool, and which model answers each call. Aggregate spend tells you the bill went up. It does not tell you why, and it definitely does not tell you what to fix.\n\n**More than 70% of Uber’s pull requests** (merge requests) are now attributed to **AI agents** (local or cloud).\n\n**Uber’s fix was to stop treating cost as one number and decompose it into six.**\n\nEvery dollar of AI spend, at any layer, breaks down as:\n\n**Users × Sessions/user × Turns/session × Requests/turn × Tokens/request × Price/token = Total cost**\n\nThe first two (users, sessions/user) are adoption and engagement. **You want those growing** — that is the point of rolling out AI tooling in the first place.\n\n**The middle three (turns, requests, tokens) are pure overhead**: work that the agent does on its own behalf, on top of whatever the engineer actually asked for. **That is where almost all of Uber’s optimization effort goes.**\n\nPrice per token is the one that you can’t control, but you still get to decide which model gets which task.\n\n**Six multiplying terms means six independent places to cut cost without touching adoption.**\n\nThree of these deserve a closer look !\n\nLets deep dive into them.\n\n**Uber’s model-selection process for every managed agent is four steps**: build a benchmark from real work, run every candidate model on the same harness, move to whichever model is Pareto-optimal (best quality for the cost), and repeat. Reason: the frontier models are shifting every few weeks/months.\n\n**uReview** which is Uber’s AI agent that automatically reviews every pull request, is the concrete example. Its benchmark runs actual PRs with known bugs, graded easy/medium/hard, scored on precision, recall, and F1 against those bugs, plus cost per review and latency. Switching models along that Pareto frontier raised uReview’s F1 score while cutting cost per review at the same time.\n\n**This is the finding I found most useful, because it is not obvious until someone measures it.**\n\n**Uber routes agent-to-tool connections through MCP** (the Model Context Protocol) via a unified gateway covering 1,000+ internal and third-party MCP servers. Standard MCP behavior loads the full schema for *every installed tool* into *every session*, whether that session ever calls the tool or not.\n\nWith 100+ tools installed, that pre-loading added roughly **50,000–70,000 tokens** to the very first prompt, before an engineer typed a single prompt, and that same schema got re-sent on every turn afterward. Third-party SaaS tools made it worse: one workspace suite alone bundles 49 tools into ~22K tokens of schema. Load two or three MCP servers and the agent is carrying more schema than the file it is about to edit.\n\n**Uber’s fix had two parts:** CLI-resolved tool calls (the model runs a shell command; the CLI resolves and invokes the actual tool against the gateway at call time, so the schema never sits in context) and tool search (the model searches a catalog and pulls in only the tool definition it actually needs, on demand).\n\n**Net effect: that 50–70K token dropped to near zero.**\n\nA related trick, code-mode i.e. **batching multiple tool calls into one script** instead of one model turn per call, **cut token usage on simple warehouse queries by 50%+ and on bulk workflows by more than 90%**, in Uber’s own measurements.\n\nAcross hundreds of millions of lines of code and thousands of tables, Uber found that **agents spend most of their turns locating information, not generating it.**\n\nTheir answer was the **AI Context Graph**: 24 million nodes, 80 million edges, integrating over 30 internal systems (services, incident logs, PRs, design docs, deployments, table-usage history) so an agent can query it in plain language instead of grepping around blind.\n\nSame prompt → “Can I query the Vehicle Lists table in Forge?”, same model, and two different results:\n\n**That is arguably more valuable than any single model swap.**\n\n**The smallest-looking lever, and probably underrated, but very effective.**\n\nUber put a **live running-cost counter directly in the terminal** status line i.e. they added spend tiers at 50/80/100% of expected budget.\n\nThey also built a **session-analysis dashboard that automatically flags** **16 anti-patterns per session.**\n\nFlagging things like **running a simple multi-turn task on an expensive model** when a cheap one would do, or **resuming a session after a break long enough to blow the prompt cache** and force a full-price context rebuild.\n\n**Cost per 1,000 model** requests dropped **34%** from its peak, and **cost per session** dropped **52%** from its June peak.\n\n**7x** more weekly active users, **9.4x** more weekly agent requests, and total AI spend that has “relatively stabilized” since April, 2026.\n\nYou do not need Uber’s type internal Context Graph or a 1,000-server MCP gateway to take something from this. The structural ideas transfer at any scale (small or even bigger than this):\n\n**Quick definitions:**\n\nSource: [Running a Software Factory Efficiently at Uber Scale](https://www.uber.com/in/en/blog/efficient-software-factory/?uclick_id=4bc5e9db-6d7e-4abd-aa9e-ec46b3d61d42)\n\n[Uber’s AI Software Factory: Cutting Cost Per Session in Half at 9.4x More Agent Requests](https://pub.towardsai.net/ubers-ai-software-factory-cutting-cost-per-session-in-half-at-9-4x-more-agent-requests-53b719c6bcfe) was originally published in [Towards AI](https://pub.towardsai.net) on Medium, where people are continuing the conversation by highlighting and responding to this story.", "url": "https://wpnews.pro/news/ubers-ai-software-factory-cutting-cost-per-session-in-half-at-9-4x-more-agent", "canonical_source": "https://pub.towardsai.net/ubers-ai-software-factory-cutting-cost-per-session-in-half-at-9-4x-more-agent-requests-53b719c6bcfe?source=rss----98111c9905da---4", "published_at": "2026-09-18 05:46:52+00:00", "updated_at": "2026-09-18 05:55:06.503498+00:00", "lang": "en", "topics": ["ai-agents", "agent-protocols", "ai-tools", "developer-tools", "ai-infrastructure"], "entities": ["Uber", "uReview", "Model Context Protocol", "MCP"], "alternates": {"html": "https://wpnews.pro/news/ubers-ai-software-factory-cutting-cost-per-session-in-half-at-9-4x-more-agent", "markdown": "https://wpnews.pro/news/ubers-ai-software-factory-cutting-cost-per-session-in-half-at-9-4x-more-agent.md", "text": "https://wpnews.pro/news/ubers-ai-software-factory-cutting-cost-per-session-in-half-at-9-4x-more-agent.txt", "jsonld": "https://wpnews.pro/news/ubers-ai-software-factory-cutting-cost-per-session-in-half-at-9-4x-more-agent.jsonld"}}