23:39
2026-08-21
runtimewire.com
ai-policy
Cloudflare syncs AI bot rules with robots.txt, closing its own policy gap
Cloudflare product manager Jin-Hee Lee will roll out Bot Preference Sync, a feature that writes AI crawler preferences from Cloudflare's dashboard into robots.txt, closing the gap between published co…