12:25
2026-09-12
ai-visibility.lastminutedealshq.com
ai-policy
368 of the top 2,771 sites block at least one AI search crawler
A 2026-09-07 census of 2,771 sites serving a robots.txt found that 368 block at least one of the three crawlers feeding AI answers, and 200 block all three. PerplexityBot is blocked by 358 sites, Clau…