# RecruitersFromIndia.com robots.txt # GEO: AI / answer-engine crawlers explicitly allowed (2026-08-21, Naomi Sarr) User-agent: * Allow: / Disallow: /admin/ Disallow: /staff/ Disallow: /employer/ Disallow: /agency/ Disallow: /notifications Disallow: /requirement-documents/ Disallow: /employer-documents/ Disallow: /api/ # Explicitly permit AI / answer-engine crawlers (GEO / AISO) User-agent: GPTBot Allow: / User-agent: OAI-SearchBot Allow: / User-agent: ChatGPT-User Allow: / User-agent: PerplexityBot Allow: / User-agent: ClaudeBot Allow: / User-agent: Claude-Web Allow: / User-agent: Claude-SearchBot Allow: / User-agent: Google-Extended Allow: / User-agent: Applebot-Extended Allow: / User-agent: CCBot Allow: / Sitemap: https://recruitersfromindia.com/sitemap.xml