Skip to content

Free tool

Will ChatGPT find your website?

One check, nine AI crawlers — server response and robots.txt, side by side.

ChatGPT can find your website only if your server returns 200 to its crawlers (GPTBot, OAI-SearchBot) and your robots.txt allows them. Most AI-invisible sites fail on one of those two - an open server with robots.txt blocking AI bots is the single most common misconfiguration.

We hit your URL with the real user-agents of GPTBot, ClaudeBot, PerplexityBot, Googlebot & co., then parse your robots.txt. Free, ~5 seconds.

What happens when you start

All your AI-search work in 5 minutes a week — not 5 hours.

1. Enter your website

We detect your services, markets and competitors automatically.

2. Agents get to work

They track your prompts across ChatGPT, Perplexity, Gemini & co., watch competitors, find content gaps, and write paste-ready fix prompts for technical issues.

3. You approve, they ship

Review the weekly report, approve fixes, close gaps with Content Studio. Runs on autopilot.

AI crawlers and what they feed

CrawlerRuns forWhat it feedsShould you allow it?
GPTBotOpenAIChatGPT training corpusYes, unless you never want ChatGPT recommending you
OAI-SearchBotOpenAIChatGPT search answersYes - this drives live citations
ChatGPT-UserOpenAILive fetches while a user asksYes
ClaudeBotAnthropicClaude answers + trainingYes
PerplexityBotPerplexityPerplexity answers + citationsYes
Google-ExtendedGoogleGemini + AI Overviews trainingYour call - blocking it doesn't affect Google Search
GooglebotGoogleSearch + AI Overviews retrievalAlways
BingbotMicrosoftBing + Copilot answersAlways
ApplebotAppleSiri + Apple IntelligenceYes

Frequently asked questions

Can ChatGPT crawl my website?
ChatGPT can crawl your website only when your server returns a 200 response to its bots (GPTBot, OAI-SearchBot) and your robots.txt allows them. This free tool tests both in one request, so you can see exactly which AI assistants are allowed in.
Which AI crawlers does this tool check?
This tool checks the real user-agents of crawlers such as GPTBot, ChatGPT-User, OAI-SearchBot, ClaudeBot, PerplexityBot, Googlebot, Google-Extended, Bingbot and Applebot - the bots ChatGPT, Claude, Perplexity and Google use to read pages.
Why does my site return 200 but still not get cited?
A 200 response only means the bot can reach your server; your robots.txt can still disallow that user-agent. Open-server plus blocked-robots is the most common AEO misconfiguration, and this tool shows the two side by side.

Related reading

Stop guessing. Start measuring.

CiteAgentic runs your prompt plan every week and tells you when AI names a competitor instead of you.

Scan my site free

See how AI sees your site.

Run your free scan — visibility score, competitor gaps, and the fixes that move it.

Scan my site freeSee plans & pricingNo credit card · free for 1 site