All tools
server
Robots & Sitemap Validator
Inspect robots.txt, sitemap declarations, XML validity, and URL counts.
PrivacyOnly public robots and sitemap files are fetched.
Loading tool environment...
How to use it
- 1Enter a public website URL.
- 2Fetch robots.txt and declared or default sitemaps.
- 3Review directives, response status, and URL counts.
Common uses
- — Find sitemap declarations.
- — Detect a global robots block.
- — Inspect basic sitemap XML structure.
Important limitations
- — The tool samples up to five declared sitemaps and enforces response-size limits.
- — It does not emulate every search-engine crawler rule.