# -------------- 开箱即用 · 禁止大部分爬虫 -------------- User-agent: GPTBot Disallow: / User-agent: ChatGPT-User Disallow: / User-agent: CCBot Disallow: / User-agent: Google-Extended Disallow: / User-agent: anthropic-ai Disallow: / User-agent: Claude-Web Disallow: / User-agent: PerplexityBot Disallow: / User-agent: Applebot Disallow: / User-agent: Applebot-Extended Disallow: / User-agent: Bingbot Disallow: / User-agent: bingbot Disallow: / User-agent: msnbot Disallow: / User-agent: msnbot-media Disallow: / User-agent: Googlebot Disallow: / User-agent: Googlebot-Image Disallow: / User-agent: Googlebot-News Disallow: / User-agent: Googlebot-Video Disallow: / User-agent: AdsBot-Google Disallow: / User-agent: AdsBot-Google-Mobile Disallow: / User-agent: Baiduspider Disallow: / User-agent: Baiduspider-image Disallow: / User-agent: Baiduspider-news Disallow: / User-agent: Baiduspider-video Disallow: / User-agent: Sogou web spider Disallow: / User-agent: Sogou inst spider Disallow: / User-agent: Sogou Pic Spider Disallow: / User-agent: 360Spider Disallow: / User-agent: HaosouSpider Disallow: / User-agent: YisouSpider Disallow: / User-agent: YoudaoBot Disallow: / User-agent: AhrefsBot Disallow: / User-agent: SemrushBot Disallow: / User-agent: MJ12bot Disallow: / User-agent: Screaming Frog SEO Spider Disallow: / User-agent: dotbot Disallow: / User-agent: MegaIndex Disallow: / User-agent: Mail.RU_Bot Disallow: / User-agent: AhrefsSiteAudit Disallow: / User-agent: sogouspider Disallow: / User-agent: Amazonbot Disallow: / # 如想一次性屏蔽所有未列出的爬虫,可再补一段 User-agent: * Disallow: / # -------------- 声明站点地图(可选) -------------- # Sitemap: https://你的域名.com/sitemap.xml