#general - map.army User-agent: * Allow: / Disallow: /test/ Disallow: /cubic/ Disallow: /swiss/ Disallow: /offline/ Disallow: /3rdpartylicenses.txt # Deep-link parameters: the SPA serves the same shell for these, so Google files # them as soft 404s. ShareID links additionally carry a per-user access token. Disallow: /*?ShareID= Disallow: /*&ShareID= Disallow: /*?layer= Disallow: /*&layer= # AI / LLM crawlers — explicitly welcomed (this site publishes /llms.txt). # Grouped on their own so the policy is intentional and visible. # # MAINTENANCE: a named group REPLACES "User-agent: *" for those agents - it does # not inherit from it. The Disallow list below must therefore stay a verbatim # copy of the one above; if the two drift, these agents get the MORE permissive # policy. Edit both blocks together, or collapse this group into "*". # # To opt an agent OUT, move it to its own group with "Disallow: /". User-agent: GPTBot User-agent: OAI-SearchBot User-agent: ChatGPT-User User-agent: ClaudeBot User-agent: Claude-User User-agent: Claude-SearchBot User-agent: Claude-Web User-agent: anthropic-ai User-agent: Google-Extended User-agent: Google-CloudVertexBot User-agent: PerplexityBot User-agent: Perplexity-User User-agent: Meta-ExternalAgent User-agent: Meta-ExternalFetcher User-agent: MistralAI-User User-agent: DuckAssistBot User-agent: CCBot User-agent: Applebot-Extended User-agent: Amazonbot User-agent: Bytespider User-agent: cohere-ai User-agent: AI2Bot User-agent: Ai2Bot-Dolma User-agent: YouBot User-agent: Diffbot User-agent: omgilibot User-agent: Webzio-Extended User-agent: ImagesiftBot User-agent: PetalBot User-agent: TimpiBot User-agent: FirecrawlAgent Allow: / Disallow: /test/ Disallow: /cubic/ Disallow: /swiss/ Disallow: /offline/ Disallow: /3rdpartylicenses.txt # Deep-link parameters: the SPA serves the same shell for these, so Google files # them as soft 404s. ShareID links additionally carry a per-user access token. Disallow: /*?ShareID= Disallow: /*&ShareID= Disallow: /*?layer= Disallow: /*&layer= Sitemap: https://www.map.army/sitemap.xml