🤖
AB-087
Google-Extended Not Blocked
What it means
Checks that robots.txt does not block the Google-Extended user-agent from crawling your site.
Why it matters
Allowing Google-Extended ensures your content is included in Google's AI training data, improving visibility in AI-powered search.
✗
What's wrong
robots.txt has 'User-agent: Google-Extended' followed by 'Disallow: /' — your content is excluded from Google AI training.
✓
What's right
robots.txt either allows Google-Extended or does not mention it, permitting training data inclusion.
Check this rule on your site
Enter your URL to check just this one rule (AB-001).