{"type": "article", "title": "AI-Aware robots.txt: Let the Right Agents In", "publisher": "Web Pulse", "url": "https://wpnews.pro/news/ai-aware-robots-txt-let-the-right-agents-in", "original_source": "https://blog.r-lopes.com/posts/agent-readiness-robots-txt", "published": "2026-07-02T14:00:00+00:00", "accessed": "2026-07-04", "id": "ai-aware-robots-txt-let-the-right-agents-in"}