Robots.txt Analyzer
Audit your robots.txt for issues
📚 Learn more — how it works, FAQ & guide Click to expand
Learn more — how it works, FAQ & guide
Click to expand
Robots.txt analyzer
How to use this tool
- 1
Paste robots.txt
Your file contents.
- 2
See directives parsed
User-agents, allows, disallows.
Frequently Asked Questions
robots.txt gotchas?
"Disallow: /" blocks everything — often accidentally ships to prod. Check before deploy.
You might also like
🔒
100% Privacy. This tool runs entirely in your browser. Your data is never uploaded to any server.