13:07
2026-08-12
dev.to
developer-tools
I let every AI crawler in. A month later I cannot tell you how many people read me
Developer Marco Bellingeri opened his website's robots.txt to all AI crawlers to boost visibility, but after receiving 33,561 pageviews in its first month, he realized the number was inflated by bots …