{"slug": "isvisible-ai-check-if-ai-crawlers-can-access-your-site", "title": "Isvisible.ai, check if AI crawlers can access your site", "summary": "Isvisible.ai launched a free tool that lets website owners check whether AI crawlers from platforms like ChatGPT, Claude, Perplexity and Google can access their site, providing a 0-100 visibility score and an agent-by-agent access map. The tool analyzes robots.txt and llms.txt files and tests live requests against 13 AI crawlers, helping businesses understand if their content is visible to AI-powered search and answer engines.", "body_md": "AI assistants are becoming the new front door to the web. Find out whether ChatGPT, Claude, Perplexity and Google AI can access your site in seconds.\n\nHow it works\n\nPaste your website address. No account or credit card required. The check starts immediately.\n\nWe check robots.txt (the file search engines already use for SEO) and llms.txt (its newer counterpart built for AI), then evaluate access rules for 13 AI crawlers like GPTBot, ClaudeBot, Perplexity and Google-Extended.\n\nReceive an instant 0-100 score with an agent-by-agent access map, so you know exactly which AI platforms can see your content.\n\nA representative example. This is exactly what you receive the moment your check completes.\n\nAI Visibility Score\n\nLimited visibility. Most AI platforms cannot see your content.\n\nVisibility Signals\n\nsearch crawlers powering AI-assisted search results\n\ncrawlers collecting content for model training\n\nreal-time retrieval when users ask AI assistants\n\nAgent-by-Agent Access · robots.txt + live probe\n\nRobots.txt block means the file disallows this crawler. Server block means the live request itself failed.\n\nHow the Score Is Calculated\n\nBased on robots.txt rules plus a live homepage request with each crawler's user agent. Cached for 60 minutes.\n\nReport generated by isvisible.ai · never shared with third parties\n\nReady to see where you stand?\n\nEnter your URL above and get this exact report for your site.\n\nCrawlers\n\nsearch crawlers powering AI-assisted search results\n\ncrawlers collecting content for model training\n\nreal-time retrieval when users ask AI assistants\n\nFAQ\n\nIt shows how many AI crawlers and search engines can reach your site right now, out of 100 points. The score combines two signals: whether each AI agent is allowed to access your pages, and whether you publish an llms.txt file.\n\nrobots.txt is a text file at the root of your domain that tells crawlers, including search engines and AI bots, which parts of your site they can access. It's the same file that already controls how Google indexes your pages.\n\nllms.txt is a newer file, published at yourdomain.com/llms.txt, that gives AI systems a clean, direct summary of your site's content. It isn't required yet, but publishing one is an easy way to tell AI answer engines what your site is about.\n\n13 crawlers across three categories: search engines like Googlebot and Bingbot, AI training crawlers like GPTBot, ClaudeBot and Common Crawl, and AI answer engines like ChatGPT's live browsing, Perplexity and OpenAI's search crawler.\n\nYes. isvisible.ai has a public API, and the exact request format is published at isvisible.ai/llms.txt specifically so AI assistants can read it. Ask ChatGPT, Claude or any AI assistant with web access to check a domain using the isvisible.ai API, and it can send the request and read the score back to you.\n\nChatGPT, Claude, Perplexity and Google AI Overviews are becoming a new way people find and evaluate businesses. If your site blocks these crawlers, your content can't be cited or recommended in AI answers, even if it ranks well in traditional search.\n\nYes. Enter your URL and get a full report in seconds, no account or credit card required.\n\nAgent access is worth 80 points and llms.txt is worth 20. If a site has no robots.txt and the live probe can't run either, access can't be confirmed, so agent points count at half weight until one of those signals is available.", "url": "https://wpnews.pro/news/isvisible-ai-check-if-ai-crawlers-can-access-your-site", "canonical_source": "https://isvisible.ai", "published_at": "2026-07-17 07:21:17+00:00", "updated_at": "2026-07-17 07:51:10.725703+00:00", "lang": "en", "topics": ["ai-tools", "ai-products", "ai-infrastructure"], "entities": ["Isvisible.ai", "ChatGPT", "Claude", "Perplexity", "Google AI", "GPTBot", "ClaudeBot", "Google-Extended"], "alternates": {"html": "https://wpnews.pro/news/isvisible-ai-check-if-ai-crawlers-can-access-your-site", "markdown": "https://wpnews.pro/news/isvisible-ai-check-if-ai-crawlers-can-access-your-site.md", "text": "https://wpnews.pro/news/isvisible-ai-check-if-ai-crawlers-can-access-your-site.txt", "jsonld": "https://wpnews.pro/news/isvisible-ai-check-if-ai-crawlers-can-access-your-site.jsonld"}}