Why 30%? CRITICAL: 6 AI bot(s) BLOCKED: OpenAI GPTBot, Anthropic ClaudeBot, Common Crawl CCBot, Google Extended, Apple Applebot-Extended, Amazon Amazonbot
βCRITICAL: 6 AI bot(s) BLOCKED: OpenAI GPTBot, Anthropic ClaudeBot, Common Crawl CCBot, Google Extended, Apple Applebot-Extended, Amazon Amazonbot
βWARNING: Googlebot is allowed but AI bots are blocked. Common misconfiguration.
βllms.txt found but lacks standard structure (H1 + link list).
βllms-full.txt also found (27684 bytes). Excellent for AI comprehensive site understanding.
βNo AI-restrictive meta tags (noai, noimageai).