User-agent: * Allow: / Allow: /app/$ Disallow: /app/ Disallow: /api Disallow: /cdn-cgi/ Sitemap: https://babacerta.com.br/sitemap-index.xml # AI Search & Retrieval bots — allow (generate citations) User-agent: OAI-SearchBot Allow: / Allow: /app/$ Disallow: /app/ Disallow: /api Disallow: /cdn-cgi/ User-agent: ChatGPT-User Allow: / Allow: /app/$ Disallow: /app/ Disallow: /api Disallow: /cdn-cgi/ User-agent: PerplexityBot Allow: / Allow: /app/$ Disallow: /app/ Disallow: /api Disallow: /cdn-cgi/ User-agent: Perplexity-User Allow: / Allow: /app/$ Disallow: /app/ Disallow: /api Disallow: /cdn-cgi/ User-agent: Claude-SearchBot Allow: / Allow: /app/$ Disallow: /app/ Disallow: /api Disallow: /cdn-cgi/ User-agent: Claude-User Allow: / Allow: /app/$ Disallow: /app/ Disallow: /api Disallow: /cdn-cgi/ # AI Training bots — allow (opted-in) User-agent: GPTBot Allow: / Allow: /app/$ Disallow: /app/ Disallow: /api Disallow: /cdn-cgi/ User-agent: ClaudeBot Allow: / Allow: /app/$ Disallow: /app/ Disallow: /api Disallow: /cdn-cgi/ User-agent: Google-Extended Allow: / Allow: /app/$ Disallow: /app/ Disallow: /api Disallow: /cdn-cgi/ User-agent: anthropic-ai Allow: / Allow: /app/$ Disallow: /app/ Disallow: /api Disallow: /cdn-cgi/ User-agent: Bytespider Allow: / Allow: /app/$ Disallow: /app/ Disallow: /api Disallow: /cdn-cgi/