Cloudflare Separates AI Training From Search Indexing With New Crawler Controls
Cloudflare introduced new AI-crawler controls on September 15, 2026 that let site owners disallow AI training while keeping their content eligible for search indexing. The update replaces the single B…