# ALL BOTS User-agent: * Disallow: /cart Disallow: /checkout Disallow: /global/ # AI Crawlers – Explicit Allowance # OpenAI User-agent: GPTBot Allow: / User-agent: ChatGPT-User Allow: / # Google AI (separate from Googlebot search) User-agent: Google-Extended Allow: / # Anthropic (Claude) User-agent: ClaudeBot Allow: / # Perplexity AI User-agent: PerplexityBot Allow: / # Common Crawl (used in many AI training datasets) User-agent: CCBot Allow: / # Disallow Reflectionbot User-agent: Reflectionbot Disallow: / # Disallow Shapbot User-agent: ShapBot Disallow: / # Disallow Sogou web spider User-agent: Sogou web spider Disallow: / Crawl-delay: 10 https://www.stellite.com/store/us/en/stellite-us/sitemap.xml # ----------------------------------------