A Billion Agents Need Somewhere to Run

Consumer-facing agentic AI products such as xAI's Grok Bot, Meta's Muse, and Instinct could push adoption from early adopters to the early majority and drive demand for server CPUs, according to an analysis of the AI infrastructure supply chain. Meta's Muse, a personal agent with its own cloud computer accessible via app or WhatsApp, reaches a family of apps with 3.6 billion daily active users, though it is starting with a US rollout. The analysis asks whether 100 million people could run 1 billion daily agents, noting that a billion daily agentic tasks does not imply a billion simultaneously active agents or CPU cores.

It finally seems like the average consumer can adopt agentic AI. Reasoning models were the first milestone, harnesses like Claude Code https://www.anthropic.com/news/enabling-claude-code-to-work-more-autonomously came next, and personal agents like OpenClaw unlocked useful work beyond just coding. Of course, running your own agent still required a willingness to tinker and spend money. Go buy a Mac Mini Spend $200/mo on Claude Code My hypothesis is that we’re on the verge of agentic AI crossing the chasm from early adopters to the early majority because product companies are turning these capabilities into simple, turnkey, yet useful services. And the upfront cost is low or zero. For now… Grok Bot https://x.ai/news/introducing-grok-bot showed the way: Free. Simple. From the video: There wasn't anything to learn. It was just like bringing on a co-worker to my team The same video hints at the impact this could on the AI infra supply chain: It's not using your computer. So you can keep doing work in parallel while bot is working on another instance. Meta shipped Muse https://ai.meta.com/muse/ recently; a personal agent with its own cloud computer, accessible through an app or WhatsApp: WhatsApp Meta’s distribution 3.6B daily active users across the family of apps is where adoption could inflect. If Meta does it right, they have a direct connection to billions of active users And AI infra demand too. Good thing they are building out all those datacenters, even if they keep getting punished by investors because of it… Of course right now Muse is starting with a US rollout so those billions of users are potential reach, not necessarily day one Muse users. But obviously downloading an app is a familiar reflex for nearly everyone in the world; setting up a Mac Mini etc is not. And btw, if you’re feeling brave, there’s also Instinct https://instinct.co/ : Consumer cloud agents will continue to accelerate demand for server CPUs. Yes we have a lot of ChatGPT and Claude adoption already amongst normies, but not necessarily heavily agentic use from most that aren’t coding/vibe-coding. Although Astra is showing more normie use cases like driving DaVinci for editing. But Muse, Grok Bot, Instinct show simple user experiences have the potential to quickly drive adoption to the masses. And each person can generate more than a single agent run per day; Grok Bot’s docs say: Multiple Bots share one user-scoped computer and can run in parallel. Could 100 million people run 1 billion daily agents? Seems plausible. Of course, a billion daily agentic tasks doesn’t imply needing a billion CPU cores because it’s not like we’ll have a billion simultaneously active agents. That said, there will still be a heck of a lot of CPU cores running simultaneous agents, and those agents will each kick off some LLM inference and quite often also stress the existing cloud infra fetching data from the web and so on . And the question is whether Grok and Meta and Instinct have enough CPUs for this growth? And these are all ADDITIVE to OpenAI and Anthropic, who will continue to innovate and make it easier for folks to use agents to do the things they find useful at work or home. What does this mean for the ecosystem? For paid subscribers: - CPUs: We obviously need more CPUs. But which ones? - Accelerators: Which accelerators? Nvidia? AMD? XPUs? Startups? - HBM and DRAM: Agents need memory for the model and for the computer it drives. Which demand grows faster? - NAND: Agents leave a lot of work behind. What does that mean for flash demand? - CoWoS and EMIB: More accelerators means more advanced packaging. Who captures the growth?