{"slug": "cloudflare-s-matthew-prince-says-bots-now-outnumber-humans-online", "title": "Cloudflare's Matthew Prince Says Bots Now Outnumber Humans Online", "summary": "Cloudflare Radar data shows bots now account for 57.4% of all HTTP requests routed through Cloudflare's network, versus 42.6% from humans, a crossover co-founder and CEO Matthew Prince had expected roughly 18 months later, he said in June. Prince told Fortune that \"clearly it's going to be pay to crawl,\" arguing publishers should be paid by AI companies for content that feeds their systems, and on September 15 Cloudflare rolled out a Disallow AI Training setting blocking crawlers from Amazon, Anthropic, Meta and OpenAI while preserving Google, Microsoft and Apple search visibility. Cloudflare routes traffic for roughly a fifth of the web and counts about 80% of the industry's largest AI companies as customers, while its Pay Per Crawl marketplace launched last year has not caught on, Prince said.", "body_md": "*Cloudflare says bots now make up 57.4% of all web traffic, more than humans, and its CEO wants AI companies to start paying for the content that feeds them.*\n\nMatthew Prince didn't think this would happen until late 2027. Instead, Cloudflare's own data shows it already has.\n\nAccording to Cloudflare Radar, the company's public traffic dashboard, bots now account for 57.4% of all HTTP requests routed through its network, against 42.6% from actual humans clicking around. Prince, Cloudflare's co-founder and CEO, said on social media in June that the crossover point he'd expected roughly 18 months out arrived almost overnight instead - driven by a surge of AI agents and crawlers hitting sites at a scale the open web was never built to handle.\n\nTalking to Fortune this week, Prince laid out where he thinks this ends up. \"Clearly it's going to be pay to crawl,\" he said. His argument is blunt: publishers and site owners are producing the content that trains and feeds these AI systems, and right now most of them get nothing for it. \"Companies need to get paid by the AI companies for what is the fuel that runs these AI systems,\" he told the outlet.\n\nThat's not a small claim. Cloudflare routes traffic for roughly a fifth of the entire web, and counts about 80% of the industry's largest AI companies as customers. So when Prince talks about bot traffic overtaking humans, he isn't guessing from the outside. He's watching it happen in real time, across a huge slice of the internet he already runs.\n\n[Bots now generate more web traffic than humans and startups are about to feel it](https://startupfortune.com/bots-now-generate-more-web-traffic-than-humans-and-startups-are-about-to-feel-it/)\n\nFor the first time in internet history, bots now generate more web traffic than humans, with automated requests hitting 57.4% of all HTTP traffic by mid-2026. Agentic AI traffic grew 7,851% year over year, according to HUMAN Security's 2026 benchmark report, arriving 18 months ahead of Cloudflare CEO Matthew Prince's own forecast. The shift... - [bot traffic inflating website metrics](https://startupfortune.com/bots-now-generate-more-web-traffic-than-humans-and-startups-are-about-to-feel-it/) - [how to detect fake bot traffic](https://startupfortune.com/bots-now-generate-more-web-traffic-than-humans-and-startups-are-about-to-feel-it/)\n\n## The fix Cloudflare can ship today\n\nThe company isn't just describing the problem. It's shipping product around it. On September 15, Cloudflare rolled out a new setting called Disallow AI Training, blocking crawlers run by Amazon, Anthropic, Meta and OpenAI that scrape pages purely to train models, while still letting a site show up in Google, Microsoft and Apple search results. Cloudflare calls crawlers that meet its transparency bar \"Accountable,\" a label it created after talks with crawler operators that began back in July. The pitch to publishers is simple: say no to AI training without disappearing from search.\n\nThat's the fix Cloudflare can ship today. Pay to crawl isn't. Prince has more or less admitted as much. Cloudflare launched a broader Pay Per Crawl marketplace last year, letting sites charge AI companies for access to their content. By his own account, it hasn't caught on. Building the protocols and payment rails to handle that kind of volume is, he says, still a work in progress.\n\nHere's the part that should worry smaller AI labs more than it worries OpenAI or Anthropic. If crawling content becomes something you pay for, the companies with the deepest pockets can strike direct licensing deals with publishers and keep training. A startup on a shoestring budget doesn't get that option. Pay to crawl doesn't just tax AI companies for using the web - it raises the price of entry into building one at all.\n\n## Who pays for the bots you can't block\n\nThere's a second cost too, quieter than the first. A growing share of that bot traffic isn't the old kind - search indexers politely reading a page and moving on. It's agentic traffic: AI systems that browse on someone's behalf, fill out forms, compare prices and complete purchases without a human ever loading the page themselves. Forbes made a similar point back in June, arguing that infrastructure built for people clicking links was never designed for machines transacting at this volume. Every server request still costs money, whether a person or a bot made it. Publishers who built their business on ad impressions from human eyeballs are now footing the bill for traffic that never sees an ad at all.\n\nThat's the gap Prince is actually pointing at. It isn't really about blocking bots. It's about who pays for the ones you can't block.\n\nNone of this is settled. Cloudflare's own numbers show how fast the ground shifted, arriving nearly two years ahead of Prince's own forecast. Whatever pricing model eventually wins out, publishers, AI labs and everyone building on the open web are now negotiating from a starting point where most of the traffic running through it isn't human any more.\n\n**Also read:** [Mainland Investors Poured $1.4 Billion Into MiniMax Stock in August](https://startupfortune.com/mainland-investors-poured-14-billion-into-minimax-stock-in-august/) • [Waymo Picks Singapore for Its First Robotaxi Launch Outside the US](https://startupfortune.com/waymo-picks-singapore-for-its-first-robotaxi-launch-outside-the-us/) • [Figure AI's Helix 2.5 Robot Made Beds in 30 Homes It Had Never Seen](https://startupfortune.com/figure-ais-helix-25-robot-made-beds-in-30-homes-it-had-never-seen/)\n\n[Cloudflare Starts Charging AI Companies for the Web Data They Once Took Free](https://startupfortune.com/cloudflare-starts-charging-ai-companies-for-the-web-data-they-once-took-free/)\n\nCloudflare has moved from tracking AI crawlers to blocking them by default on ad-supported pages starting September 15, 2026, while shifting its payment model from per-crawl fees toward paying publishers only when their content shows up in a generated answer. The shift turns years of free AI scraping into a metered cost, backed by Cloudflare data... - [cloudflare charging AI companies for web](https://startupfortune.com/cloudflare-starts-charging-ai-companies-for-the-web-data-they-once-took-free/) - [how AI crawlers access published web](https://startupfortune.com/cloudflare-starts-charging-ai-companies-for-the-web-data-they-once-took-free/)\n\n*This article is posted in [AI News](https://startupfortune.com/category/ai/), check it out for more related stories.*\n\n## Join the discussion\n\n[Open in the community →](https://startupfortune.com/community/)\n\nAlmost there. Sign in and your reply posts straight away.", "url": "https://wpnews.pro/news/cloudflare-s-matthew-prince-says-bots-now-outnumber-humans-online", "canonical_source": "https://startupfortune.com/cloudflares-matthew-prince-says-bots-now-outnumber-humans-online/", "published_at": "2026-09-18 12:43:20+00:00", "updated_at": "2026-09-18 12:53:24.930982+00:00", "lang": "en", "topics": ["ai-crawlers", "ai-policy", "generative-engine-optimization", "ai-agents", "artificial-intelligence"], "entities": ["Cloudflare", "Matthew Prince", "Cloudflare Radar", "Fortune", "Amazon", "Anthropic", "Meta", "OpenAI"], "alternates": {"html": "https://wpnews.pro/news/cloudflare-s-matthew-prince-says-bots-now-outnumber-humans-online", "markdown": "https://wpnews.pro/news/cloudflare-s-matthew-prince-says-bots-now-outnumber-humans-online.md", "text": "https://wpnews.pro/news/cloudflare-s-matthew-prince-says-bots-now-outnumber-humans-online.txt", "jsonld": "https://wpnews.pro/news/cloudflare-s-matthew-prince-says-bots-now-outnumber-humans-online.jsonld"}}