📜
AB-048
Agents.txt File
📜 Agents.txt
Pillar: Discovery
Moderate effort
Severity: medium
Est. cost: $10-50
Gap: documentation
Fix: deterministic
What it means
Your site has an agents.txt file with instructions specifically for AI agents.
Why it matters
Agents.txt is like robots.txt but for AI agents — it tells them what they can do and how to behave on your site.
Evidence expected
This rule is verified by:
http html Source: Website content
✗
What's wrong
No agents.txt. AI agents don't know your preferences for how they should interact.
✓
What's right
A clear agents.txt guides AI agents on how to interact with your site.
Check this rule on your site
Enter your URL to check just this one rule (AB-001).
Machine-Readable
This rule is also available as JSON: /rules/AB-048.json
Explore More
-
All Rules
Browse the complete rules catalog
-
Agent Guide
Learn how to fix this rule
-
Blog
Related articles on agent readiness