# 所有搜索引擎与 AI 爬虫默认可抓取全站 User-agent: * Allow: / # —— 明确欢迎以下 AI 引擎爬虫抓取(希望被 AI 搜索引用,故不设屏蔽)—— # OpenAI(ChatGPT / SearchGPT) User-agent: GPTBot Allow: / User-agent: OAI-SearchBot Allow: / # Anthropic(Claude) User-agent: ClaudeBot Allow: / User-agent: anthropic-ai Allow: / # Perplexity User-agent: PerplexityBot Allow: / # Google(Gemini / AI Overviews 内容来源) User-agent: Google-Extended Allow: / User-agent: Googlebot Allow: / # 字节跳动(豆包 / 夸克生态) User-agent: Bytespider Allow: / # Apple(Apple Intelligence) User-agent: Applebot Allow: / User-agent: Applebot-Extended Allow: / # Meta User-agent: meta-externalagent Allow: / # 常见搜索引擎 User-agent: Bingbot Allow: / User-agent: Baiduspider Allow: / User-agent: Sogou web spider Allow: / User-agent: YisouSpider Allow: / Sitemap: https://seomoz.link/sitemap.xml