# Zwier — robots.txt # Default: allow all standard crawlers. User-agent: * Allow: / # ─── AI crawlers: explicit allow ──────────────────────────────────────────── # We want Zwier to be discoverable when users ask AI assistants about group # event planning, date finders, expense splitting, etc. Listing each agent # explicitly so the policy is unambiguous and survives future default shifts. # OpenAI User-agent: GPTBot Allow: / User-agent: ChatGPT-User Allow: / User-agent: OAI-SearchBot Allow: / # Anthropic User-agent: ClaudeBot Allow: / User-agent: Claude-Web Allow: / User-agent: anthropic-ai Allow: / # Perplexity User-agent: PerplexityBot Allow: / User-agent: Perplexity-User Allow: / # Google (AI Overviews / Gemini training opt-in) User-agent: Google-Extended Allow: / # Apple Intelligence / Siri grounding User-agent: Applebot Allow: / User-agent: Applebot-Extended Allow: / # Common Crawl (feeds many open-source models) User-agent: CCBot Allow: / # Meta AI User-agent: Meta-ExternalAgent Allow: / User-agent: Meta-ExternalFetcher Allow: / # ByteDance / Doubao User-agent: Bytespider Allow: / # You.com User-agent: YouBot Allow: / # Mistral AI User-agent: MistralAI-User Allow: / Sitemap: https://zwier.app/sitemap.xml