13:00
2026-07-01
letsdatascience.com
ai-policy
Cloudflare Blocks Mixed-Use Crawlers on Monetized Pages
Cloudflare announced it will default to blocking mixed-use crawlers from accessing ad-supported customer websites, citing broken crawl-for-traffic bargains with AI companies. The move affects roughly …