03:31
2026-08-22
dev.to
ai-infrastructure
AI crawler user agents are self-reported: 468 real fetches, 991 fake ones
A developer found that most AI crawler traffic on their site is fake, with only 468 of 1,459 requests actually fetching articles. Using Cloudflare's verifiedBotCategory, they showed that only 13% of G…