User-agent: Googlebot Disallow: /forum/conversations/ Disallow: /forum/members/ Disallow: /forum/media/users/ Disallow: /forum/account/ Disallow: /forum/goto/ Disallow: /forum/admin.php Disallow: /forum/credits/ Disallow: /forum/find-new/ Disallow: /forum/search/ User-agent: * Disallow: /forum/conversations/ Disallow: /forum/members/ Disallow: /forum/media/users/ Disallow: /forum/account/ Disallow: /forum/goto/ Disallow: /forum/admin.php Disallow: /forum/credits/ Disallow: /forum/find-new/ Disallow: /forum/search/ # --- AI SEARCH/REFERRAL BOTS (ALLOWED - they cite us and send human traffic) --- User-agent: OAI-SearchBot Allow: / User-agent: ChatGPT-User Allow: / User-agent: PerplexityBot Allow: / # --- AI TRAINING & UNPAID SCRAPERS (BLOCKED - they extract, give nothing back) --- User-agent: GPTBot Disallow: / User-agent: ClaudeBot Disallow: / User-agent: anthropic-ai Disallow: / User-agent: Claude-Web Disallow: / User-agent: Applebot-Extended Disallow: / User-agent: CCBot Disallow: / User-agent: Google-Extended Disallow: / User-agent: omgili Disallow: / User-agent: omgilibot Disallow: / User-agent: Diffbot Disallow: / User-agent: cohere-ai Disallow: / User-agent: Meta-ExternalAgent Disallow: / User-agent: Meta-ExternalFetcher Disallow: / User-agent: Amazonbot Disallow: / User-agent: ImagesiftBot Disallow: / User-agent: 360Spider Disallow: / User-agent: AhrefsBot Disallow: / User-agent: Baiduspider Disallow: / User-agent: Bytespider Disallow: / User-agent: DataForSeoBot Disallow: / User-agent: DotBot Disallow: / User-agent: MJ12bot Disallow: / User-agent: SemrushBot Disallow: / User-agent: YandexBot Disallow: / Sitemap: https://www.photrio.com/forum/sitemap.php