Index & Discovery

Meta Robots Check

Inspect page-level indexing directives across meta tags and response headers.

Free · instant

Run a deterministic technical check

The result comes from HTTP requests, parsers and maintained rules — no AI guessing, so it is reproducible.

A specific public page, e.g. https://yourbrand.com/guides/one
01

What does this tool check?

Indexing directives hide in two places: <meta name="robots"> (plus bot-specific variants) and the X-Robots-Tag response header, which CDNs and plugins often add silently. We merge both and show the effective directive set.

02

How should I read the result?

A noindex anywhere wins over everything else. "noai" style tokens are not a standard, but some vendors state they honor them — we report them separately from noindex.

03

What should I do next?

If a page should be visible and this check finds noindex, look at your CDN and SEO plugin settings first — that is where surprise headers come from.

Sources: Google robots meta 文档

InsightWonder

This checked one page

InsightWonder scans the whole site, ranks what to fix by impact, and keeps watching so a template change does not silently de-index a section.

Run a full analysis
  • Scheduled re-checks with change alerts
  • Visibility and citations across five AI engines
  • Fixes ranked by impact, with content generated
Meta Robots Checker — meta Tags and X-Robots-Tag Header