besttea1.com — AI Crawler Readiness
Public AI crawler readiness report for besttea1.com: score, bot access, discovery files, and actionable recommendations.
Readiness summary
Score: 75/100 · Grade: B+
Last checked:
AI crawler access
- CCBot — Allowed (Common Crawl)
- GPTBot — Allowed (OpenAI)
- Diffbot — Allowed (Diffbot)
- Amazonbot — Allowed (Amazon)
- ClaudeBot — Allowed (Anthropic)
- Cohere-ai — Allowed (Cohere)
- Bytespider — Allowed (ByteDance)
- FacebookBot — Allowed (Meta)
- ChatGPT-User — Allowed (OpenAI)
- anthropic-ai — Allowed (Anthropic)
- PerplexityBot — Allowed (Perplexity)
- Google-Extended — Allowed (Google)
- Applebot-Extended — Allowed (Apple)
- Meta-ExternalAgent — Allowed (Meta)
Discovery and page signals
- llms.txt: ✓
- ai.txt: ✕
- JSON-LD: ✓
- FAQ Schema: ✓
- Meta description: ✓
- Open Graph: ✓
Recommendations
- Add /llms.txt to help AI systems understand your site
- Consider adding /ai.txt for AI usage policies