Is my site blocking AI bots?

Enter a site or a page URL. We fetch its robots.txt and show, for 14 AI crawlers, whether they may fetch that URL and which rule decides it. Googlebot and Bingbot are shown for comparison.

Training, search and user fetches are separate crawlers

OpenAI, Anthropic and Perplexity each run one crawler for model training or indexing and another that fetches pages when a user asks about them. Blocking GPTBot keeps your content out of OpenAI training but leaves OAI-SearchBot free to list you in ChatGPT search. Decide per crawler.

Google-Extended does not affect Google Search

Google-Extended and Applebot-Extended are tokens, not crawlers. Googlebot and Applebot do the fetching; the token only controls whether the content may be used for AI. Blocking them leaves your search rankings alone. Blocking Googlebot does not.

What robots.txt cannot tell you

robots.txt is a request. Crawlers that ignore it are not stopped by it.
A CDN or firewall rule (for example Cloudflare's AI bot blocking) can refuse AI crawlers before robots.txt is read. This checker does not see those blocks.
Most crawlers match only the most specific group that names them. If GPTBot has its own group, the * rules do not apply to it. Test any path with the robots.txt tester.

We fetch robots.txt once, as NoindexWatchBot. Results are not stored.