Is this page actually indexable—and by whom?

Paste a URL. Robotsread fetches the page and its robots.txt, reconciles all four conflicting sources of indexability, and names the exact rule that stops indexing. One verdict. No assembly required.

Check a URL →

Indexability is decided in four places that contradict each other

A search crawler obeys four separate signals to decide whether to index a page. When one blocks and the others permit, most tools report each signal separately and leave the reader to reconcile them. This tool states the verdict and names the rule that produced it.

robots.txt

A Disallow rule tells crawlers not to fetch the page at all. Most common cause of accidental blocking.

meta robots

A <meta name="robots" content="noindex"> tag in the page HTML tells crawlers not to index it.

X-Robots-Tag

An HTTP response header that overrides any page-level directive. Set by the server, invisible in the HTML.

Canonical

A <link rel="canonical"> pointing to a different URL tells crawlers the canonical version lives elsewhere.

How it works

1

Enter a URL

Paste any public page URL. The tool fetches that page and its origin's robots.txt — nothing more.

2

All four signals are parsed

The tool reads the Disallow rules from robots.txt, extracts the meta robots tag, checks the X-Robots-Tag response header, and evaluates the canonical link.

3

Single verdict delivered

The most restrictive rule wins. You get one answer: Indexable, Blocked, or Unknown — plus the exact rule and line that caused it.

Capabilities

Single-verdict reconciliation — no more cross-referencing four separate reports
Exact rule location — names the line in robots.txt or the tag/header that blocks
Signal-by-signal breakdown — every signal's raw content shown for manual inspection
Cloudflare-aware — detects when a host behind Cloudflare cannot be reached from the diagnostic tool
Stateless & private — no accounts, no stored data, no server-side logs of checked URLs
No crawl beyond the URL — fetches exactly the page you typed and its robots.txt; never follows links

Note on limitations: This tool reports what the indexability rules say about a page. It does not predict Google's actual ranking behaviour. Sites behind Cloudflare may produce false-negative results due to Cloudflare loop protection — the tool flags this when detected.