User-agent: * Allow: / # AI Search Bots - explicitly allowed User-agent: GPTBot Allow: / User-agent: ChatGPT-User Allow: / User-agent: PerplexityBot Allow: / User-agent: ClaudeBot Allow: / User-agent: anthropic-ai Allow: / User-agent: Google-Extended Allow: / # Block training-only crawlers User-agent: CCBot Disallow: / # Block authenticated routes from all crawlers User-agent: * Disallow: /dashboard Disallow: /clinic-portal Disallow: /clinic-dashboard Disallow: /messages Disallow: /settings Disallow: /payment Disallow: /admin Disallow: /admin/ Disallow: /checkout Disallow: /booking Disallow: /review Disallow: /invite Disallow: /welcome Disallow: /auth Disallow: /forgot-password Disallow: /reset-password Disallow: /matches Sitemap: https://jetwell.ai/sitemap.xml