Quick answer
You can have multiple User-agent groups.
robots.txt Duplicate User-agent
You can have multiple User-agent groups. Duplicate User-agent: * merges rules in some parsers.
Common causes
- Same User-agent twice.
- Merged rules confusion.
How to fix
- One group per User-agent or document.
- Keep rules clear per group.
FAQ
- Duplicate User-agent?
- Some parsers merge.
- Best practice?
- One * group.
Fix it now
Try in validator (prefill this example)