sharing.tw — AI 爬蟲準備度

sharing.tw 的公開 AI 爬蟲準備度報告:分數、機器人存取、探索檔案與改善建議。

準備度摘要

分數: 2/100 · 等級: F

最近檢查:

造訪網站

AI 爬蟲存取

  • CCBot — 封鎖 (Common Crawl)
  • AI2Bot — 封鎖 (Allen Institute for AI)
  • GPTBot — 封鎖 (OpenAI)
  • YouBot — 封鎖 (You.com)
  • Diffbot — 封鎖 (Diffbot)
  • Timpibot — 封鎖 (Timpi)
  • Amazonbot — 封鎖 (Amazon)
  • ClaudeBot — 封鎖 (Anthropic)
  • Cohere-ai — 封鎖 (Cohere)
  • Omgilibot — 封鎖 (Webz.io)
  • Bytespider — 封鎖 (ByteDance)
  • Claude-User — 封鎖 (Anthropic)
  • FacebookBot — 封鎖 (Meta)
  • ChatGPT-User — 封鎖 (OpenAI)
  • ImagesiftBot — 封鎖 (Hive / ImageSift)
  • anthropic-ai — 封鎖 (Anthropic)
  • DuckAssistBot — 封鎖 (DuckDuckGo)
  • OAI-SearchBot — 封鎖 (OpenAI)
  • PerplexityBot — 封鎖 (Perplexity)
  • Google-Extended — 封鎖 (Google)
  • Perplexity-User — 封鎖 (Perplexity)
  • Claude-SearchBot — 封鎖 (Anthropic)
  • Applebot-Extended — 封鎖 (Apple)
  • Meta-ExternalAgent — 封鎖 (Meta)
  • Meta-ExternalFetcher — 封鎖 (Meta)

探索與頁面訊號

  • llms.txt:
  • ai.txt:
  • JSON-LD:
  • FAQ Schema:
  • Meta description:
  • Open Graph:

改善建議

  1. Page is marked noindex (meta/X-Robots-Tag) — AI search indexes will skip this content.
  2. Unblock AI crawlers in robots.txt: GPTBot, ChatGPT-User, Google-Extended
  3. Add JSON-LD structured data for AI comprehension
  4. Add FAQPage schema for AI answer extraction
  5. Add a meta description for AI summaries
  6. Add Open Graph tags (og:title, og:description)
  7. Optional: add /llms.txt to help AI systems understand your site
  8. Optional: add /ai.txt for AI usage policies

檢查其他網站