Robots.txt Checker

Analyze robots.txt directives, user-agents, allow/disallow rules, and sitemap links.