🔍
AB-001
Robots.txt File
What it means
Your site has a robots.txt file that tells crawlers and AI agents what they can access.
Why it matters
Without this file, AI agents don't know which parts of your site they're allowed to read, and may skip your content entirely.
✗
What's wrong
No robots.txt file found. Agents assume nothing is allowed.
✓
What's right
A clear robots.txt welcomes AI agents to explore your content.
Check this rule on your site
Enter your URL to check just this one rule (AB-001).