- Excluded by 'noindex' tagHow to find and fix it
- Indexed, though blocked by robots.txtWhat it means and what to do
- Blocked by robots.txtFind the rule and fix it
- Duplicate, Google chose different canonical than userHow to fix it
- Page with redirectWhen to fix it and when to leave it
Check a page now
The guides link to these tools. Each one runs once on the URL you enter, with no signup.
Status, redirects, meta robots, X-Robots-Tag, canonical and robots.txt for one URL.
Open the tool robots.txt testerPaste or fetch a robots.txt and test up to 25 paths for 8 crawlers. Flags syntax problems.
Open the tool AI bot checkerWhich of 14 AI crawlers your robots.txt blocks, and who runs each one.
Open the tool X-Robots-Tag checkerThe indexing headers a URL sends on every redirect hop, including PDFs.
Open the toolHear about it the same day
Search Console can take days to show a new status. NoindexWatch checks the URLs you choose for noindex, X-Robots-Tag, robots.txt, canonical, redirect and sitemap changes, and tells you by email, Slack or Discord when something changes. Free plan: 1 site, up to 20 URLs, checked daily, no card.