cd /news/ai-tools/isvisible-ai-check-if-ai-crawlers-ca… · home topics ai-tools article
[ARTICLE · art-63290] src=isvisible.ai ↗ pub= topic=ai-tools verified=true sentiment=· neutral

Isvisible.ai, check if AI crawlers can access your site

Isvisible.ai launched a free tool that lets website owners check whether AI crawlers from platforms like ChatGPT, Claude, Perplexity and Google can access their site, providing a 0-100 visibility score and an agent-by-agent access map. The tool analyzes robots.txt and llms.txt files and tests live requests against 13 AI crawlers, helping businesses understand if their content is visible to AI-powered search and answer engines.

read3 min views1 publishedJul 17, 2026
Isvisible.ai, check if AI crawlers can access your site
Image: source

AI assistants are becoming the new front door to the web. Find out whether ChatGPT, Claude, Perplexity and Google AI can access your site in seconds.

How it works

Paste your website address. No account or credit card required. The check starts immediately.

We check robots.txt (the file search engines already use for SEO) and llms.txt (its newer counterpart built for AI), then evaluate access rules for 13 AI crawlers like GPTBot, ClaudeBot, Perplexity and Google-Extended.

Receive an instant 0-100 score with an agent-by-agent access map, so you know exactly which AI platforms can see your content.

A representative example. This is exactly what you receive the moment your check completes.

AI Visibility Score

Limited visibility. Most AI platforms cannot see your content.

Visibility Signals

search crawlers powering AI-assisted search results

crawlers collecting content for model training

real-time retrieval when users ask AI assistants

Agent-by-Agent Access · robots.txt + live probe

Robots.txt block means the file disallows this crawler. Server block means the live request itself failed.

How the Score Is Calculated

Based on robots.txt rules plus a live homepage request with each crawler's user agent. Cached for 60 minutes.

Report generated by isvisible.ai · never shared with third parties

Ready to see where you stand?

Enter your URL above and get this exact report for your site.

Crawlers

search crawlers powering AI-assisted search results

crawlers collecting content for model training

real-time retrieval when users ask AI assistants

FAQ

It shows how many AI crawlers and search engines can reach your site right now, out of 100 points. The score combines two signals: whether each AI agent is allowed to access your pages, and whether you publish an llms.txt file.

robots.txt is a text file at the root of your domain that tells crawlers, including search engines and AI bots, which parts of your site they can access. It's the same file that already controls how Google indexes your pages.

llms.txt is a newer file, published at yourdomain.com/llms.txt, that gives AI systems a clean, direct summary of your site's content. It isn't required yet, but publishing one is an easy way to tell AI answer engines what your site is about.

13 crawlers across three categories: search engines like Googlebot and Bingbot, AI training crawlers like GPTBot, ClaudeBot and Common Crawl, and AI answer engines like ChatGPT's live browsing, Perplexity and OpenAI's search crawler.

Yes. isvisible.ai has a public API, and the exact request format is published at isvisible.ai/llms.txt specifically so AI assistants can read it. Ask ChatGPT, Claude or any AI assistant with web access to check a domain using the isvisible.ai API, and it can send the request and read the score back to you.

ChatGPT, Claude, Perplexity and Google AI Overviews are becoming a new way people find and evaluate businesses. If your site blocks these crawlers, your content can't be cited or recommended in AI answers, even if it ranks well in traditional search.

Yes. Enter your URL and get a full report in seconds, no account or credit card required.

Agent access is worth 80 points and llms.txt is worth 20. If a site has no robots.txt and the live probe can't run either, access can't be confirmed, so agent points count at half weight until one of those signals is available.

── more in #ai-tools 4 stories · sorted by recency
── more on @isvisible.ai 3 stories trending now
sponsored brought to you by zahid.host 4,200+ EU-deployed projects
reading about agents? ship yours in a single git push.

Run your AI side-project on zahid.host

EU-based hosting, git-push deploys, automatic HTTPS, no cold starts. Free tier with a custom domain — perfect for shipping the agent you just read about.

$git push zahid main
Live at https://your-agent.zahid.host
Get free account → Pricing
from €0/mo · no card required
LIVE [news/isvisible-ai-check-i…] indexed:0 read:3min 2026-07-17 ·