IndexedAI — Make your website readable by AI agents
Free beta · No account required<br>Make your website<br>readable by AI agents<br>Enter a URL. Get your Agent Readiness Score, a custom llms.txt, and a live MCP endpoint — in under 90 seconds.<br>Send report to<br>Analyze my siteResults sent to your email · Takes 30–90 seconds
How it works<br>Three steps to agent-ready.
Crawl<br>IndexedAI scrapes up to 6 pages, reads robots.txt and sitemap.xml, detects API endpoints and documentation links.
Score & Generate<br>Your Agent Readiness Score is calculated across 5 axes. Claude then generates a tailored llms.txt and llms-full.txt.
Get your MCP endpoint<br>Your site gets a live MCP server. Connect Claude Desktop, Cursor, or any AI client with a single JSON config — no extra setup.
~60s<br>Average analysis time
MCP<br>Endpoint per site
Readiness axes scored
What you get<br>Your site, measured.<br>Every report breaks down readiness across 5 axes that matter to AI agents, LLM pipelines, and search assistants.
Agent Readiness Report — stripe.com<br>Score<br>69<br>/ 100<br>Partially Ready
Discoverability15/20
robots.txt foundsitemap.xml found4 pages crawledNo llms.txt yet
Parsability18/20
Title presentMeta description > 50 charsH1 structure clearHomepage > 500 words
Token Efficiency12/20
Content Navigation Possible duplicate content
Capability Signaling10/20
API endpoints detectedPricing page foundNo /docs detected
Access Control14/20
All pages publicly accessibleNo AI bot rules in robots.txt
MCP endpoint<br>Your site, ready for any AI agent.<br>Connect Claude Desktop, Cursor, GPT, or any MCP client in seconds. No custom integrations, no API keys to manage.
MCP Configuration — Claude Desktop<br>Built-in MCP tools<br>get_index<br>Get the structured llms.txt index of this site. Call this first — shows site purpose, sections, and important pages.
fetch_pageurl: string<br>Fetch the full text content of any page on this site. Returns clean readable text, no HTML.
get_full_context<br>Extended context: all major sections, API endpoints, pricing, capabilities, and FAQ.
Pro plans also get site-specific dynamic tools — auto-generated from your crawl data.
Paste into Claude Desktop config<br>"mcpServers": {<br>"your-domain.com": {<br>"url": "https://indexedai.tech/api/mcp/{id}",<br>"transport": "streamable-http"<br>Works with any MCP-compatible client: Claude Desktop, Cursor, Continue, Cline and more.
Analytics<br>Know which AI agents visit your site.<br>Every MCP tool call is logged. See how AI traffic trends over time and which models are reading your content.
AI visits<br>Last 30 days
284<br>+34% vs prev period
AI agents<br>AgentVisitsLast seenClaude/3.7-Sonnet1422025-06-05GPT-4o (OpenAI)872025-06-04PerplexityBot/1.0342025-06-03Cursor/0.48.0212025-06-01
284 AI visits total<br>Upgrade to Pro to see agent breakdown<br>See plans
Claude Code skill<br>Query any IndexedAI site directly from Claude Code<br>/indexedai domain.com your question — fetches structured MCP data instead of raw HTML. Zero context overhead: MCP loads only when invoked.
View on GitHub
Sample output<br>This is what lands in your inbox.<br>Score breakdown + two ready-to-deploy files: llms.txt and llms-full.txt.
Your Agent Readiness Report — stripe.com<br>From: IndexedAI
Score breakdown<br>Total69/100<br>Discoverability15/20<br>Parsability18/20<br>Token Efficiency12/20<br>Capability Signaling10/20<br>Access Control14/20
Your site is well-structured but missing llms.txt and AI bot rules in robots.txt. Deploy the attached files to boost agent discoverability.
llms.txt preview<br># Stripe
> Online payment infrastructure for the internet.<br>> Millions of companies use Stripe to accept payments,<br>> send payouts, and manage their businesses online.
## Core Products<br>- [Payments](https://stripe.com/payments): Accept and optimize payments globally<br>- [Billing](https://stripe.com/billing): Subscriptions and recurring revenue<br>- [Connect](https://stripe.com/connect): Payments for platforms and marketplaces
## API & Docs<br>- [API Reference](https://stripe.com/docs/api): Complete REST API documentation<br>- [Quickstart](https://stripe.com/docs/quickstart): Integrate in minutes
Pricing<br>Simple, transparent pricing.<br>Start free. Upgrade when you need more sites or analytics.
Free<br>$0/month
1 site<br>MCP endpoint<br>Agent Readiness Score<br>llms.txt generation<br>Get started free<br>Most popular<br>Pro<br>/month
5 sites<br>MCP endpoint per site<br>Agent Readiness Score<br>llms.txt + llms-full.txt<br>Priority processing<br>Analytics dashboard<br>Get started<br>Agency<br>/month
10 sites<br>MCP endpoint per site<br>Agent Readiness Score<br>llms.txt + llms-full.txt<br>Priority processing<br>Analytics dashboard<br>Coming soon
Payments processed securely by Stripe. Cancel anytime.
FAQ<br>Questions
What is llms.txt?<br>llms.txt is a plain-text file at the root of your website (/llms.txt) that tells AI agents what your site is about, what pages matter, and how to navigate your content efficiently. Think robots.txt — but for LLMs.
What is an MCP endpoint?<br>MCP (Model Context Protocol) is an open standard for connecting AI agents to external data sources....