Finding 01 · AI crawler access · High impact
Search and citation bots are blocked in robots.txt
People using ChatGPT, Perplexity, and similar tools may never see your business
Your site currently tells several AI systems not to read it. That is usually a default or an old “block all AI” rule — not a deliberate choice. Opening the door for search and citation bots is a short robots.txt edit.
Why it matters to your business. You can rank on Google and still be invisible in AI answers if the wrong bots are blocked.
robots.txt Disallow for GPTBot, ClaudeBot, and PerplexityBot
Explicit User-agent groups for GPTBot, ClaudeBot, and PerplexityBot include Disallow: /. Googlebot remains allowed. Training vs search/citation tiers are reported separately.
Measured: 3 AI search/citation agents fully disallowed
Exact repair
Allow: / for GPTBot, ClaudeBot, and PerplexityBot; keep training scrapers blocked only if that is policy.