Robots.txt Tester
Analyze any website's robots.txt file. See user-agent rules, disallow directives, and sitemap declarations.
View Raw Content
See the complete robots.txt file exactly as search engines see it.
Parse Rules
Understand allow/disallow rules for each user-agent at a glance.
Find Sitemaps
Discover all sitemap URLs declared in the robots.txt file.