{"type": "article", "title": "Robots-check: see what your robots.txt is serving (Cloudflare AI Crawl Control)", "publisher": "Web Pulse", "url": "https://wpnews.pro/news/robots-check-see-what-your-robots-txt-is-serving-cloudflare-ai-crawl-control", "original_source": "https://github.com/janibert1/robots-check", "published": "2026-09-09T03:15:27+00:00", "accessed": "2026-09-09", "id": "robots-check-see-what-your-robots-txt-is-serving-cloudflare-ai-crawl-control"}