sharing.tw — AI 爬蟲準備度
sharing.tw 的公開 AI 爬蟲準備度報告:分數、機器人存取、探索檔案與改善建議。
準備度摘要
分數: 2/100 · 等級: F
最近檢查:
AI 爬蟲存取
- CCBot — 封鎖 (Common Crawl)
- AI2Bot — 封鎖 (Allen Institute for AI)
- GPTBot — 封鎖 (OpenAI)
- YouBot — 封鎖 (You.com)
- Diffbot — 封鎖 (Diffbot)
- Timpibot — 封鎖 (Timpi)
- Amazonbot — 封鎖 (Amazon)
- ClaudeBot — 封鎖 (Anthropic)
- Cohere-ai — 封鎖 (Cohere)
- Omgilibot — 封鎖 (Webz.io)
- Bytespider — 封鎖 (ByteDance)
- Claude-User — 封鎖 (Anthropic)
- FacebookBot — 封鎖 (Meta)
- ChatGPT-User — 封鎖 (OpenAI)
- ImagesiftBot — 封鎖 (Hive / ImageSift)
- anthropic-ai — 封鎖 (Anthropic)
- DuckAssistBot — 封鎖 (DuckDuckGo)
- OAI-SearchBot — 封鎖 (OpenAI)
- PerplexityBot — 封鎖 (Perplexity)
- Google-Extended — 封鎖 (Google)
- Perplexity-User — 封鎖 (Perplexity)
- Claude-SearchBot — 封鎖 (Anthropic)
- Applebot-Extended — 封鎖 (Apple)
- Meta-ExternalAgent — 封鎖 (Meta)
- Meta-ExternalFetcher — 封鎖 (Meta)
探索與頁面訊號
- llms.txt: ✕
- ai.txt: ✕
- JSON-LD: ✕
- FAQ Schema: ✕
- Meta description: ✕
- Open Graph: ✕
改善建議
- Page is marked noindex (meta/X-Robots-Tag) — AI search indexes will skip this content.
- Unblock AI crawlers in robots.txt: GPTBot, ChatGPT-User, Google-Extended
- Add JSON-LD structured data for AI comprehension
- Add FAQPage schema for AI answer extraction
- Add a meta description for AI summaries
- Add Open Graph tags (og:title, og:description)
- Optional: add /llms.txt to help AI systems understand your site
- Optional: add /ai.txt for AI usage policies