robots.txt Invalid Path
Disallow and Allow take a path prefix. Invalid or wrong path can block or allow unexpectedly.
Common causes
- Typo in path.
- Wrong wildcard.
How to fix
- Use path starting with /.
- Test with robots.txt tester.
FAQ
- Path format?
- Start with /.
- Wildcard?
- * supported by many.
Fix it now
Try in validator (prefill this example)