Isvisible.ai, check if AI crawlers can access your site

alpkorpe1 pts0 comments

Free AI visibility tool: Is your website visible to AI?<br>Free AI visibility audit<br>Is your website<br>visible to AI?<br>AI assistants are becoming the new front door to the web. Find out whether ChatGPT, Claude, Perplexity and Google AI can access your site in seconds.<br>Run free check<br>Free · No signup required · Results in seconds

How it works<br>Three steps to your AI visibility score

01Enter your URL<br>Paste your website address. No account or credit card required. The check starts immediately.

02We analyze access<br>We check robots.txt (the file search engines already use for SEO) and llms.txt (its newer counterpart built for AI), then evaluate access rules for 13 AI crawlers like GPTBot, ClaudeBot, Perplexity and Google-Extended.

03Get your report<br>Receive an instant 0-100 score with an agent-by-agent access map, so you know exactly which AI platforms can see your content.

Sample report<br>What your report includes<br>A representative example. This is exactly what you receive the moment your check completes.

isvisible.ai · Sample Report<br>example.com · Jul 2026<br>AI Visibility Score<br>43out of 100Grade D<br>Limited visibility. Most AI platforms cannot see your content.

Visibility Signals<br>robots.txt<br>llms.txt<br>live probe

Search Engines2/2

search crawlers powering AI-assisted search results

AI Training Crawlers1/7

crawlers collecting content for model training

AI Answer Engines4/4

real-time retrieval when users ask AI assistants

Agent-by-Agent Access · robots.txt + live probe<br>Robots.txt block means the file disallows this crawler. Server block means the live request itself failed.<br>Google SearchALLOWED<br>Bing / CopilotALLOWED<br>Google Gemini & AI Overviews trainingALLOWED<br>OpenAI GPTBot (training)BLOCKED · robots.txt<br>ChatGPT live browsingALLOWED<br>OpenAI search crawlerALLOWED<br>Anthropic ClaudeBot (training)BLOCKED · robots.txt<br>Claude live browsingALLOWED<br>Perplexity crawlerALLOWED<br>Common Crawl (used to train many LLMs)BLOCKED · robots.txt<br>ByteDance / TikTok AIBLOCKED · server<br>Apple Intelligence trainingBLOCKED · robots.txt<br>Meta AI trainingBLOCKED · robots.txt

7/13<br>AI Agents Allowed

Agents Blocked

found<br>robots.txt

missing<br>llms.txt

How the Score Is Calculated<br>AI agent access

43/80<br>llms.txt present

0/20

Based on robots.txt rules plus a live homepage request with each crawler's user agent. Cached for 60 minutes.

Report generated by isvisible.ai · never shared with third parties<br>robots.txt scanllms.txt check13 AI agents

0-100 AI visibility score with grade

Agent-by-agent access map for 13 AI crawlers

robots.txt and llms.txt signal check (the SEO files that now also control AI crawler access)

Search, training and answer-engine breakdown

Transparent scoring methodology

One-page PDF report download

Ready to see where you stand?<br>Enter your URL above and get this exact report for your site.<br>Check my site

Crawlers<br>The 13 AI crawlers we check

Search Engines<br>search crawlers powering AI-assisted search results<br>GooglebotGoogle's main crawler for classic web search indexing.<br>BingbotMicrosoft's crawler for Bing search and Copilot's grounding.

AI Training Crawlers<br>crawlers collecting content for model training<br>Google-ExtendedControls whether Google can use your content to train Gemini and build AI Overviews, separate from regular search indexing.<br>GPTBotOpenAI's crawler that collects content to train future GPT models.<br>ClaudeBotAnthropic's crawler that collects content to train Claude models.<br>CCBotCommon Crawl's crawler. Its open dataset gets reused to train many different companies' models, not just one.<br>BytespiderByteDance's crawler, used to train its AI models.<br>Applebot-ExtendedControls whether Apple can use your content to train Apple Intelligence.<br>meta-externalagentMeta's crawler for training its AI models.

AI Answer Engines<br>real-time retrieval when users ask AI assistants<br>ChatGPT-UserFires when someone asks ChatGPT to browse or read a specific page live.<br>OAI-SearchBotOpenAI's crawler for ChatGPT's search feature, indexing pages it can cite in answers.<br>Claude-UserFires when someone asks Claude to browse or fetch a page live.<br>PerplexityBotPerplexity's crawler, indexes pages to cite in its AI-generated answers.

FAQ<br>Common questions about AI visibility

What is an AI visibility score?It shows how many AI crawlers and search engines can reach your site right now, out of 100 points. The score combines two signals: whether each AI agent is allowed to access your pages, and whether you publish an llms.txt file.

What is robots.txt?robots.txt is a text file at the root of your domain that tells crawlers, including search engines and AI bots, which parts of your site they can access. It's the same file that already controls how Google indexes your pages.

What is llms.txt?llms.txt is a newer file, published at yourdomain.com/llms.txt, that gives AI systems a clean, direct summary of your site's content. It isn't required yet, but publishing one is an easy way to tell AI answer engines what your site is about.

Which AI crawlers does...

robots search crawlers crawler access llms

Related Articles