dralberthuang.com — AI Crawler Readiness
Public AI crawler readiness report for dralberthuang.com: score, bot access, discovery files, and actionable recommendations.
Readiness summary
Score: 87/100 · Grade: A
Last checked:
AI crawler access
- CCBot — Allowed (Common Crawl)
- AI2Bot — Allowed (Allen Institute for AI)
- GPTBot — Allowed (OpenAI)
- YouBot — Allowed (You.com)
- Diffbot — Allowed (Diffbot)
- Timpibot — Allowed (Timpi)
- Amazonbot — Allowed (Amazon)
- ClaudeBot — Allowed (Anthropic)
- Cohere-ai — Allowed (Cohere)
- Omgilibot — Allowed (Webz.io)
- Bytespider — Allowed (ByteDance)
- Claude-User — Allowed (Anthropic)
- FacebookBot — Allowed (Meta)
- ChatGPT-User — Allowed (OpenAI)
- ImagesiftBot — Allowed (Hive / ImageSift)
- anthropic-ai — Allowed (Anthropic)
- DuckAssistBot — Allowed (DuckDuckGo)
- OAI-SearchBot — Allowed (OpenAI)
- PerplexityBot — Allowed (Perplexity)
- Google-Extended — Allowed (Google)
- Perplexity-User — Allowed (Perplexity)
- Claude-SearchBot — Allowed (Anthropic)
- Applebot-Extended — Allowed (Apple)
- Meta-ExternalAgent — Allowed (Meta)
- Meta-ExternalFetcher — Allowed (Meta)
Discovery and page signals
- llms.txt: ✓
- ai.txt: ✕
- JSON-LD: ✓
- FAQ Schema: ✕
- Meta description: ✓
- Open Graph: ✓
Recommendations
- Add FAQPage schema for AI answer extraction
- Optional: add /ai.txt for AI usage policies