All tools
server
Validator Robots & Sitemap
Periksa robots.txt, deklarasi sitemap, validitas XML, dan jumlah URL.
PrivacyHanya file robots dan sitemap publik yang diambil.
Loading tool environment...
How to use it
- 1Enter a public website URL.
- 2Fetch robots.txt and declared or default sitemaps.
- 3Review directives, response status, and URL counts.
Common uses
- — Find sitemap declarations.
- — Detect a global robots block.
- — Inspect basic sitemap XML structure.
Important limitations
- — The tool samples up to five declared sitemaps and enforces response-size limits.
- — It does not emulate every search-engine crawler rule.