NoindexWatch

Free noindex & robots.txt checker

Is your page blocked from Google? Enter a URL to check the HTTP status, redirects, X-Robots-Tag header, meta robots tag, canonical and robots.txt rules for Googlebot, Bingbot and AI crawlers.

What this checks

• Meta robots: <meta name="robots" content="noindex"> (and googlebot/bingbot variants).
• X-Robots-Tag: HTTP header noindex, often set by a server or CDN rule and invisible in the HTML.
• robots.txt: whether Googlebot, Bingbot, GPTBot, ClaudeBot, PerplexityBot and others may crawl the URL, using the same longest-match rules Google uses.
• Status and redirects: 4xx/5xx errors and redirect chains.
• Canonical: canonical tags that point somewhere else.

We fetch the page and robots.txt once, as NoindexWatchBot. Results are not stored.