MCP server that checks whether a website is set up for AI the way its owner intends: can GPTBot, ClaudeBot, PerplexityBot and 50+ other AI crawlers read it, and what does its access policy allow? Generates llms.txt, an AI-crawler robots.txt and JSON-LD, reads your Answer Analysis, and checks whether a page permits an AI use.
mcp robots-txt json-ld cursor access-policy gptbot llms-txt model-context-protocol mcp-server ai-readiness ai-crawlers ai-permissions machine-readiness
-
Updated
Oct 29, 2026 - JavaScript