robots.txt Tester
Test robots.txt rules: paste content or fetch by site URL. Test paths against user-agent.
About this tool
Validates syntax (User-agent, Disallow, Allow, Sitemap) and lets you test whether specific paths are allowed or blocked for a given user-agent. Paste robots.txt or enter a site URL to fetch /robots.txt from our server.
Fetches <site>/robots.txt via our server. Content is loaded into the editor below; then run Validate.
Test paths (one per line)
Click "Validate" to check your code
You might also need