Your robots.txt probably does not block the AI crawler you think it blocks (Web Pulse, 2026)
Original source: https://dev.to/angeo/your-robotstxt-probably-does-not-block-the-ai-crawler-you-think-it-blocks-5g3n