FAQ
Questions people ask about Robotto
About the checker, the results and the data we keep. If yours isn't here, email contact@robotto.org.
The checker
What is Robotto?
A free tool that checks a list of domains for problems that cost search and AI traffic. It follows redirects, reads robots.txt, tests AI crawler access, finds the sitemap, checks HTTPS, looks up expiry through RDAP and times the home page. Scheduled monitoring with alerts is coming next.
Do I need an account?
No. Open the checker, paste your domains and run it. Nothing to sign up for.
How many domains can I check?
Up to 10 per run and 30 per day from one connection. The count resets at midnight UTC.
Where do the checks run from?
From a Cloudflare Worker, on Cloudflare's network. Requests go out from Cloudflare data centers, usually one close to you. Your own IP address never touches the sites being checked.
Does it run JavaScript or render pages?
No. It reads raw HTTP responses, the way most crawlers do on their first pass. A noindex tag that's only added by JavaScript won't be seen, and neither will content behind a login.
Reading the results
What counts as the canonical host?
The address that most of the four versions (http, https, with and without www) end up on after redirects. If they end on different addresses, you get a red verdict and both are listed.
Why do you flag 302 redirects?
A 302 or 307 says the move is temporary. For moving http to https or one host to another you want a permanent 301 or 308, so search engines consolidate on the new address. Google often works it out anyway, but there's no reason to make it guess.
Is a missing robots.txt a problem?
Usually not. A 404 for robots.txt means crawlers may fetch everything. It becomes a problem when robots.txt returns a server error or times out, because Google then holds back crawling until it can read the file.
How reliable is the AI edge-block test?
It's a good first signal. We send one request with GPTBot's user agent and compare it with a normal request. Real crawlers come from their operators' own IP ranges, and some firewalls let verified bots through while blocking imitations, so a pass or a block here is a strong hint, not proof.
Why does my domain show no expiry date?
The registry didn't give one. A few country-code registries have no public RDAP service or leave the expiration event out. Check your registrar's dashboard for the date.
Privacy and limits
Do you store the domains I check?
No. Results go back to your browser and aren't saved on our side. Cloudflare keeps standard request logs for a short time, as it does for every site on its network.
What does my browser store?
The last result for each domain you checked (status, canonical address, robots.txt hash and expiry) in local storage, so the next run can show changes. Use "Forget all" under the results to remove it.
Do you use cookies or analytics?
No cookies, no analytics, no ads, no third-party scripts. See the privacy page.
Are you connected to the Robotto service that used this domain before?
No. This Robotto was relaunched in 2026 under new, independent management and has no connection to the earlier service or the domain's previous owners.
Still stuck? Email contact@robotto.org with the domain you checked and what you expected to see.