{"slug": "the-first-derivative-of-inference", "title": "The First Derivative of Inference", "summary": "AI inference has become the fastest-growing market in technology, projected to reach $250 billion within seven years, surpassing the database market. Companies like Anthropic, Google Cloud, Datadog, and Twilio are benefiting as \"first derivatives of inference,\" with Datadog reporting that AI customers represent 80% of its annual recurring revenue despite being only 20% of its total customer base. For pre-AI software companies, the only path to growth is reselling inference or profiting from customers purchasing large volumes of it.", "body_md": "The fastest-growing companies in AI & software are either selling AI directly or reselling inference. At worst, they are the first derivative of inference.\n\nInference is the largest & fastest growing market in technology today, surpassing the database market & projected to be three times the size within seven years at $250 billion. 1,\n\nAnthropic has booked $9b & $10b in consecutive months. 3 Google Cloud is growing 63% at an $80 billion run rate.\n\nFor public software & infrastructure companies that predate AI, there are two standouts so far : Twilio & Datadog.\n\nBoth of these companies are benefiting as the first derivatives of inference. They don’t sell inference primarily, but anyone building AI systems needs to understand how they perform, & agentic companies with voice use Twilio.\n\n“The number of spans sent to our LLM Observability product nearly tripled quarter-over-quarter.” — Olivier Pomel, CEO, Datadog Q1 2026 Earnings Call\n\nAs a result of AI growing so spectacularly, there are huge power law dynamics.\n\n“We now have over 6,500 customers sending data for one or more of our AI integrations. Though this is only 20% of total customers, they represent about 80% of our ARR.” — Olivier Pomel, CEO, Datadog Q1 2026 Earnings Call\n\n[5]\n\nThis is also true for another element of core infrastructure, voice & SMS via telephone.\n\n“Voice reimagined through the lens of AI is increasingly an entry point to the Twilio platform for AI natives & enterprises alike.” — Khozema Shipchandler, CEO, Twilio Q1 2026 Earnings Call\n\n[6]\n\nA few customers can drive tremendous gains. This level of concentration is characteristic of the current cycle.[7](https://tomtunguz.com/index.xml#fn:7)\n\nFor any pre-AI company, the key question must be put at the board level : how do we either resell inference or benefit from our customers buying huge volumes of it?\n\nThat’s the only way out of the Saaspocalypse.", "url": "https://wpnews.pro/news/the-first-derivative-of-inference", "canonical_source": "https://www.tomtunguz.com/first-derivative-of-inference/", "published_at": "2026-05-15 00:00:00+00:00", "updated_at": "2026-05-29 17:36:47.308817+00:00", "lang": "en", "topics": ["artificial-intelligence", "ai-infrastructure", "ai-startups", "ai-products", "generative-ai"], "entities": ["Anthropic", "Google Cloud", "Twilio", "Datadog", "Olivier Pomel", "Khozema Shipchandler"], "alternates": {"html": "https://wpnews.pro/news/the-first-derivative-of-inference", "markdown": "https://wpnews.pro/news/the-first-derivative-of-inference.md", "text": "https://wpnews.pro/news/the-first-derivative-of-inference.txt", "jsonld": "https://wpnews.pro/news/the-first-derivative-of-inference.jsonld"}}