Robots.txt Tester

Fetch and parse any site's robots.txt. Test whether a specific URL path is allowed or blocked for Googlebot, Bingbot, and other crawlers.