User-agent: GPTBot Disallow: / # Block OpenAI's GPTBot (ChatGPT training) User-agent: GPTBot Disallow: / # Block Google's Gemini (AI training purposes) User-agent: Google-Extended Disallow: / # Block Anthropic/Claude's crawlers User-agent: anthropic-ai Disallow: / User-agent: Claude-Web Disallow: / User-agent: ClaudeBot Disallow: / # Block Perplexity AI User-agent: PerplexityBot Disallow: / # Block Common Crawl (used by many AI projects) User-agent: CCBot Disallow: / # Block Facebook/Meta AI User-agent: FacebookBot Disallow: / # Block PiplBot (data collection) User-agent: PiplBot Disallow: /