# nothingtoreport.org crawl policy # Everything here is public and meant to be found. Search engines, answer # engines and AI assistants are welcome: the brand would rather be cited # accurately than paraphrased from somewhere else. User-agent: * Allow: / # Answer engines and AI assistants, listed so the intent is explicit. # To opt one out, remove it here AND give it its own group, e.g. # User-agent: CCBot # Disallow: / # (removing it alone just falls back to the * group above, which allows all). User-agent: OAI-SearchBot User-agent: ChatGPT-User User-agent: GPTBot User-agent: Claude-SearchBot User-agent: Claude-User User-agent: ClaudeBot User-agent: PerplexityBot User-agent: Perplexity-User User-agent: Google-Extended User-agent: Applebot-Extended User-agent: CCBot Allow: / Sitemap: https://www.nothingtoreport.org/sitemap.xml # A plain-text brief for language models: https://www.nothingtoreport.org/llms.txt