# Allow AI search indexing and user-requested retrieval of public content. User-agent: OAI-SearchBot Allow: / Disallow: /api/ Disallow: /admin/ Disallow: /qa/ User-agent: ChatGPT-User Allow: / Disallow: /api/ Disallow: /admin/ Disallow: /qa/ User-agent: Claude-SearchBot Allow: / Disallow: /api/ Disallow: /admin/ Disallow: /qa/ User-agent: Claude-User Allow: / Disallow: /api/ Disallow: /admin/ Disallow: /qa/ # Keep training crawlers separate from search and user retrieval. User-agent: GPTBot Disallow: / User-agent: ClaudeBot Disallow: / User-agent: * Allow: / Disallow: /api/ Disallow: /admin/ Disallow: /qa/ Sitemap: https://www.notco.ai/sitemap.xml