Which AI bots can read your site?
Type your website. We read its robots.txt and show which of 15 AI crawlers (OpenAI, Anthropic, Google, Perplexity, Apple and more) it lets in.
Also free: the llms.txt generator and the AI SEO audit.
Questions
Which AI bots should I allow in robots.txt?
If you want to be recommended in AI answers, allow the search bots: OAI-SearchBot (ChatGPT search), Claude-SearchBot, PerplexityBot, and the bots that open a page when someone asks about it (ChatGPT-User, Claude-User, Perplexity-User). Training bots like GPTBot, ClaudeBot and CCBot are a separate choice: blocking them keeps your content out of future training data.
Does blocking GPTBot remove me from ChatGPT?
Not from ChatGPT search: that uses OAI-SearchBot, a different bot. Blocking GPTBot keeps your pages out of OpenAI's model training. Blocking OAI-SearchBot is what keeps you out of ChatGPT's search answers.
How do I block or allow an AI bot in robots.txt?
Add a group for the bot by name: "User-agent: GPTBot" on one line, then "Disallow: /" to block it or "Allow: /" to let it in. A rule written for a bot by name wins over the catch-all "User-agent: *" group.
My robots.txt allows everything. Will AI recommend me?
Not automatically. Being crawlable only means AI can read you. Whether it names you depends on what's written about you across the web. The free AI visibility check shows whether ChatGPT and Claude name you today.
Do you store my robots.txt?
No. We fetch it once to read the rules and show the result.
Track it daily
One check is a snapshot. Answers change every day.
Track up to 50 buyer questions on ChatGPT and Gemini, your top 10 every day, with competitor share-of-voice and citation analysis. $19/mo.