Rule testerCheck whether a URL is crawlable by Googlebot, Bingbot or AI bots.
Syntax checkSpot typos, unknown directives and misplaced rules.
Sitemap validationURL count, size limits, duplicates, dates and wrong domains.
Live URL samplingConfirms sitemap URLs return 200 and are not blocked.
Why this matters
A single stray Disallow: / can remove a site from Google. A sitemap full of redirects or error pages wastes crawl budget. This tool reads both files the way a crawler would and flags what is wrong.
Read-only: we request robots.txt, your sitemaps and a few sampled URLs. Private and internal addresses are blocked.