# Allow all major search engines to crawl the site User-agent: * Disallow: /admin/ Disallow: /login/ Disallow: /cart/ Disallow: /checkout/ Disallow: /search Allow: / User-agent: ChatGPT-User User-agent: OAI-SearchBot User-agent: GPTBot Allow: / User-agent: PerplexityBot User-agent: Perplexity-User Allow: / User-agent: ClaudeBot Allow: / User-agent: bingbot Allow: / User-agent: msnbot Allow: / # Sitemap reference for faster indexing Sitemap: https://infros.io/sitemap.xml Sitemap: https://infros.io/llms.txt Sitemap: https://infros.io/sitemap.xml