{"slug": "ai-compute-has-a-switchboard-problem-orchestration-plane-needed", "title": "AI Compute Has a Switchboard Problem:  Orchestration Plane Needed!", "summary": "Anthropic earned $11.5 billion in Q2 2026, more than its entire 2025 revenue, as CEO Dario Amodei called growth 'just crazy' and 'too hard to handle.' Bank of America projects AI compute demand will outstrip supply through 2029, with GPU lead times stretching to 36–52 weeks, while global data-center capex is on track to surpass $1 trillion in 2026, according to Dell'Oro Group. The article argues that the AI compute market suffers from a 'switchboard problem'—manual, wasteful GPU procurement—and calls for an orchestration plane to improve access and efficiency.", "body_md": "# AI Compute Has a Switchboard Problem: Orchestration Plane Needed!\n\n*by Gaurav Sharma with Alan J Weissberger*\n\n**Introduction:**\n\n**Anthropic** [**1.**] earned more revenue in the second quarter of 2026 than it did in all of 2025. The Claude AI maker company[ raked in $11.5 billion](https://www.cnbc.com/2026/08/15/anthropic-revenue-jumps-to-over-11point5-billion-in-q2-report.html) between April and June 2026, up from $787 million in the year-earlier quarter, $4.73 billion in Q1-2026 and up from ~[ $10 billion for the entire previous year](https://venturebeat.com/technology/anthropic-says-it-hit-a-30-billion-revenue-run-rate-after-crazy-80x-growth). CEO Dario Amodei told[ CNBC](https://www.cnbc.com/2026/05/06/anthropic-ceo-dario-amodei-says-company-crew-80-fold-in-first-quarter.html) that the growth had been “just crazy” and “too hard to handle,” with demand far outstripping the company’s ability to build infrastructure with demand racing ahead of the company’s ability to scale infrastructure.\n\nAnthropic is not alone.[ Bank of America projects](https://tomtunguz.com/ai-compute-crisis-2026/) that AI compute demand will outstrip supply through 2029.[ GPU lead times](https://vexxhost.com/blog/gpu-capacity-crisis-ai-infrastructure-2026/) now stretch to 36–52 weeks.\n\n**Note 1**.** Anthropic** is an American artificial intelligence startup founded by former OpenAI members that focuses on developing safety-oriented, steerable, and interpretable large language models like the Claude AI assistant.\n\nThis is happening even as the industry throws historic capital at capacity. Global data-center capital expenditure (capex) is on track to [ surpass $1 trillion in 2026](https://www.mobileworldlive.com/ai-cloud/data-centre-capex-to-top-1t-as-ai-spending-accelerates/), according to\n\n**Dell’Oro Group**. Yet the teams building with AI still cannot procure the compute they need, when they need it, at a price that lets them survive long enough to validate their thesis. The AI compute market has a switchboard problem — and fixing it calls for the same kind of thinking that transformed telecommunications.\n\n**The Access Gap:**\n\nAI-first startups now devote [40 to 50 percent of revenue](https://www.getmonetizely.com/blogs/the-economics-of-ai-first-b2b-saas-in-2026) to GPU hosting and inference compute, and their gross margins sit between [25 and 60 percent](https://valueaddvc.com/blog/the-true-cost-of-running-an-ai-product-in-2026-gpu-api-and-inference-bills) — versus 75 to 85 percent for traditional software companies. Compute has become the single largest cost line for most AI businesses, and it dictates what a team can afford to build.\n\nMeanwhile, meaningful enterprise GPU capacity sits dormant. Teams hoard hardware for fear of losing access, locking accelerators into long-term reservations that sit underused overnight and between training runs. The capacity exists; the coordination does not.\n\nThe burden lands hardest on those who cannot afford the reservation game. Founders step down to cheaper hardware that slows their research. Teams cut experiments because they cannot secure enough accelerators. Projects stall while usable compute sits idle behind someone else’s contract. In this environment, access — not merit — decides which ideas reach the market and which never get tested.\n\n**From Switchboards to Packet Switching:**\n\nThe early telephone network was run by hand. Every call required an operator to connect the subscriber — and each call claimed a dedicated circuit for its entire duration, even during silence. It worked, but it was slow, labor-intensive and wasteful.\n\n**GPU procurement** works the same way today. An AI team identifies the hardware it wants, negotiates a reservation with a hyperscaler — AWS, Microsoft Azure or Google Cloud — and waits for capacity to become available. Each commitment locks a slice of the fleet to a single customer. The process is manual, slow and wasteful.\n\nTelecommunications escaped this model in stages. Automated switching removed the operator; packet switching removed the dedicated circuit. Instead of reserving an entire line for one conversation, the network segmented each message into packets and routed them over whatever path had spare capacity, allowing many conversations to share a single trunk through statistical multiplexing. The same physical infrastructure carried far more traffic because capacity was allocated dynamically rather than reserved in advance.\n\n**AI compute** needs an analogous shift: an **orchestration plane** that discovers available accelerators across multiple sources and routes each workload to suitable hardware — without the customer negotiating each connection individually.\n\nIt is already taking shape. Vendors are building orchestration systems that aggregate capacity from owned infrastructure, data centres and distributed GPU providers, then present it to the customer as a single service. The customer submits a job; the orchestration layer selects suitable hardware, assembles a cluster and delivers it.\n\n**Different Workloads, Different Routing:**\n\n**Orchestration** must be workload-aware. Pre-training the largest frontier models requires thousands of accelerators coupled over low-latency fabrics with precise topology; these jobs will continue to demand dense, purpose-built clusters.\n\nInference, fine-tuning and research are far more elastic. They tolerate geographic spread and run across a wider, more heterogeneous hardware pool. This mirrors how packet-switched networks treat traffic types differently while carrying them on shared infrastructure: a voice call needs bounded latency and continuity, while an email is routed over whatever path has spare capacity.\n\nThat differentiation opens the door for network operators. Data-centre operators and carriers already own much of the physical connectivity — fibre, points of presence, interconnection — needed to knit scattered compute into a coherent supply system. Rather than letting AI infrastructure consolidate into a small number of hyperscalers, the industry can use existing transport and edge assets to link regional data centres and GPU providers into a broader, more liquid market.\n\n**Measuring What Matters:**\n\nThe trillions in planned capex should be judged by more than the number of GPUs installed. If new capacity flows mainly to customers who can lock in multi-year reservations, the supply of compute grows even as the population of companies able to use it shrinks — fewer experiments, fewer competing hypotheses, a smaller set of teams shaping what AI becomes.\n\nA healthier market would let AI teams reach compute from multiple providers through a single, well-connected service, with the network doing the work of matching each job to the right hardware — the telecoms discipline of statistical multiplexing applied to the GPU fleet.\n\nTelecommunications offers the template. Every forward step it took made the same physical infrastructure serve more users. AI compute looks ready for the same move. The hardware is there; what’s missing is the network that connects it.\n\n**References:**", "url": "https://wpnews.pro/news/ai-compute-has-a-switchboard-problem-orchestration-plane-needed", "canonical_source": "https://techblog.comsoc.org/2026/09/01/ai-compute-has-a-switchboard-problem-orchestration-plane-needed/", "published_at": "2026-09-01 19:33:59+00:00", "updated_at": "2026-09-01 19:51:49.866553+00:00", "lang": "en", "topics": ["ai-infrastructure", "ai-policy"], "entities": ["Anthropic", "Dario Amodei", "Bank of America", "Dell'Oro Group", "AWS", "Microsoft Azure", "Google Cloud"], "alternates": {"html": "https://wpnews.pro/news/ai-compute-has-a-switchboard-problem-orchestration-plane-needed", "markdown": "https://wpnews.pro/news/ai-compute-has-a-switchboard-problem-orchestration-plane-needed.md", "text": "https://wpnews.pro/news/ai-compute-has-a-switchboard-problem-orchestration-plane-needed.txt", "jsonld": "https://wpnews.pro/news/ai-compute-has-a-switchboard-problem-orchestration-plane-needed.jsonld"}}