About Robotto
A small tool for people who look after a lot of domains and can't open every one of them every week.
Robotto is run by a small team that manages a few hundred domains of its own: active sites, parked names and some we bought for projects that never happened. We kept finding the same problems too late. A robots.txt copied from staging. A redirect that dropped the www version after a DNS move. A renewal that failed because a card expired. An AI crawler block switched on by a CDN default nobody chose.
None of these are hard to fix. They're hard to notice, because nothing breaks loudly. Traffic just drifts down until someone asks why.
So we built a checker that looks at a domain the way a crawler does, from the outside, and reports the boring details in one row: where every version redirects, what robots.txt says to each crawler, whether the sitemap is real, when the registration expires and how fast the server answers.
How it works
When you press Run checks, your browser sends each domain to our Cloudflare Worker. The Worker resolves the names, follows the redirects hop by hop, fetches robots.txt and the sitemap, sends one request with an AI crawler's user agent, and asks the registry for the expiry date through RDAP. It sends the result straight back to you and keeps nothing except a daily counter used for the rate limit.
The checker refuses IP addresses, internal hostnames and unusual ports, and every redirect is checked again before it's followed, so it can only be pointed at public websites. Details are on the bot page.
What's next
Scheduled monitoring: the same checks on a schedule, a history per domain, and email when something changes or a domain gets close to expiring. If you'd like to try it early, email contact@robotto.org.
Who wrote the guides
The guides are written by the Robotto Team, the same people who build the checker. When something depends on a search engine's or a crawler operator's own rules, we link to their documentation so you can check it yourself.
History of this domain
Robotto was relaunched in 2026 under new, independent management. It is not affiliated with the earlier Robotto service that used this domain, and has no connection to the domain's previous owners. Nothing here is carried over from the old site.
See it on your own domains. Free, no signup.
Run a check