04:01
2026-07-09
digiday.com
artificial-intelligence
Media Briefing: Declared ‘good bots,’ mixed-use crawlers, gray scrapers – how AI accesses publisher content
Cloudflare is rolling out new rules for 'mixed crawlers' that can be used for both search and AI training, setting a Sept. 15 deadline to block training and agent use by default on ad-supported pages.…