# All AI Chatbots - Allowed Access to the website User-agent: ChatGPT-User Allow: / User-agent: GPTBot Allow: / User-agent: anthropic-ai Allow: / User-agent: Claude-Web-Search Allow: / User-agent: Claude-Web Allow: / User-agent: ClaudeBot Allow: / User-agent: cohere-ai Allow: / User-agent: DuckAssistBot Allow: / User-agent: PerplexityBot Allow: / User-agent: Quora-Bot Allow: / User-agent: Meta-ExternalAgent Allow: / User-agent: meta-externalagent Allow: / User-agent: Amazonbot Allow: / User-agent: Applebot-Extended Allow: / User-agent: CCBot Allow: / User-agent: FacebookBot Allow: / User-agent: Google-CloudVertexBot Allow: / User-agent: Google-Extended Allow: / User-agent: Bard Allow: / User-agent: Bingbot Allow: / User-agent: BingPreview Allow: / User-agent: MSNBot Allow: / User-agent: Slurp Allow: / User-agent: YandexBot Allow: / User-agent: Baiduspider Allow: / User-agent: Sogou Allow: / User-agent: 360Spider Allow: / User-agent: AhrefsBot Allow: / User-agent: SemrushBot Allow: / User-agent: MJ12bot Allow: / User-agent: DotBot Allow: / User-agent: BLEXBot Allow: / User-agent: PetalBot Allow: / User-agent: ZoominfoBot Allow: / User-agent: CensysInspect Allow: / User-agent: Neevabot Allow: / User-agent: Omgilibot Allow: / User-agent: rogerbot Allow: / User-agent: Screaming Frog SEO Spider Allow: / User-agent: Sitebulb Allow: / User-agent: UptimeRobot Allow: / User-agent: Pingdom Allow: / User-agent: StatusCake Allow: / User-agent: GTmetrix Allow: / User-agent: PageSpeed Insights Allow: / User-agent: Googlebot Allow: / User-agent: Googlebot-Image Allow: / User-agent: Googlebot-News Allow: / User-agent: Googlebot-Video Allow: / User-agent: Mediapartners-Google Allow: / User-agent: APIS-Google Allow: / User-agent: AdsBot-Google Allow: / User-agent: AdsBot-Google-Mobile Allow: / User-agent: AdsBot-Google-Mobile-Apps Allow: / # Catch-all for any AI or search bot not explicitly listed above User-agent: * Allow: / Disallow: /config Disallow: /search Disallow: /account$ Disallow: /account/ Disallow: /commerce/digital-download/ Disallow: /api/ Allow: /api/ui-extensions/ Disallow: /static/ Disallow: /*?author=* Disallow: /*&author=* Disallow: /*?tag=* Disallow: /*&tag=* Disallow: /*?month=* Disallow: /*&month=* Disallow: /*?view=* Disallow: /*&view=* Disallow: /*?format=json Disallow: /*&format=json Disallow: /*?format=page-context Disallow: /*&format=page-context Disallow: /*?format=main-content Disallow: /*&format=main-content Disallow: /*?format=json-pretty Disallow: /*&format=json-pretty Disallow: /*?format=ical Disallow: /*&format=ical Disallow: /*?reversePaginate=* Disallow: /*&reversePaginate=* # Sitemap Sitemap: https://chatorey.com.au/sitemap.xml