Free while in beta
Check redirects, robots.txt, AI crawlers and expiry for 10 domains
Enter the domains you care about. Each one gets checked live from our Cloudflare Worker, and the results stay in this browser so the next run can show what changed.
Results
| Domain | Canonical | robots.txt | AI crawlers | Sitemap | HTTPS | Expiry | Speed | Indexing | Details |
|---|
ok fine warn worth a look fail fix soon info no verdict
Checked before in this browser
What each column means
The table gives one verdict per column. Open Details on any row to see the raw redirect hops, the robots.txt rules that matched, the DNS answers and the registration data.
| Column | What we test | When it turns amber or red |
|---|---|---|
| Canonical | http and https, with and without www, every redirect hop | The four versions end on different hosts, plain http is the final version, a chain needs more than two redirects, or a 302/307 is used where a permanent redirect belongs |
| robots.txt | Status, size, content type, a short hash of the file | The file disallows everything for all crawlers, returns an HTML or JSON page, or can't be fetched |
| AI crawlers | Rules for GPTBot, ClaudeBot, PerplexityBot, Google-Extended and CCBot, plus one request as GPTBot | Every AI crawler is blocked, or the edge returns 401, 403, 429 or 503 to GPTBot while normal requests get a page |
| Sitemap | The first Sitemap line in robots.txt, else /sitemap.xml and /sitemap_index.xml | The URL answers with an HTML page or something that isn't a sitemap |
| HTTPS | Whether the https version completes a trusted TLS handshake, and whether it sends HSTS | https fails while http works |
| Expiry | The expiration date and registrar from RDAP | 30 days or fewer turns amber, 7 days or fewer red |
| Speed | Time to first byte and full download of the home page | TTFB over 600 ms is amber, over 1.5 seconds red |
| Indexing | Meta robots and X-Robots-Tag on the home page | noindex or none is present |
Timing is measured from Cloudflare's network, close to wherever you are, so it's a fair picture of what a visitor nearby sees. It is one sample. Run it twice before you blame your host.
Changes since your last run
When you check a domain, your browser saves four things about it: the home page status code, the canonical address, the robots.txt hash and the expiry date. Check the same domain later and the row says what changed. A new robots.txt hash means someone edited the file. A new expiry date usually means the domain renewed.
This history lives only in your browser's local storage. Clear your site data or switch browsers and it starts fresh. Use Export CSV if you want a record you can keep or diff in a spreadsheet.
Limits
You can check 30 domains a day from one connection, and up to 10 in a single run. The count resets at midnight UTC. We count per visitor so the free service stays quick, and we store the count against a scrambled daily value rather than your IP address.
The checker identifies itself as RobottoCheck. The one exception is the AI crawler test, which sends a single home page request with GPTBot's user agent so we can compare the answers. More about our bot.
Questions about the checker
Why does one domain take a few seconds?
Each check makes up to about two dozen requests. Four redirect chains, a DNS lookup for each host, robots.txt, the sitemap, a second home page request with an AI crawler's user agent, and an RDAP query to the registry. Slow servers and slow registries add time; nothing waits longer than eight seconds.
Why is expiry "unknown" for my domain?
Some country-code registries don't run a public RDAP service, and some don't publish an expiration date at all. The checker shows the registry's answer and leaves the cell gray when there isn't one. Your registrar's dashboard always has the real date.
Can I check a subdomain or a single page?
You can check any public hostname, such as shop.example.com. Paths are dropped, because every check starts at the home page and the site root. RDAP lookups always use the registered domain, so shop.example.com is looked up as example.com.
What can't it check?
IP addresses, internal names like intranet.local, and ports other than 80 and 443 are refused on purpose. The checker only talks to public websites. It also can't log in, run JavaScript or see pages behind a cookie banner that blocks bots.