Quick answer
Blocking User-agent: Googlebot or * prevents Google from crawling.
robots.txt Blocking Googlebot
Blocking User-agent: Googlebot or * prevents Google from crawling. Fix to allow.
Common causes
- Disallow: / for *.
- Blocking Googlebot specifically.
How to fix
- Allow Googlebot or remove Disallow.
- Test with robots.txt tester.
FAQ
- Block Googlebot?
- Disallow for Googlebot or *.
- Allow?
- Remove or narrow rule.
Fix it now
Try in validator (prefill this example)