Cloudflare’s AI Crawler Rules Can Block Googlebot
Cloudflare is updating its AI crawler controls to categorize bots by behavior—search, agent, or training—and will block training and agent crawlers by default on ad-supported sites starting September 15. The changes may …