User-agent: * Disallow: /agency/ Disallow: /independent/ Disallow: /member/ Disallow: /admin-dash/ Disallow: /arrowchat/ Disallow: /shortcodes/ Disallow: /cronjobs/ User-agent: ia_archiver Disallow: / User-agent: SemrushBot Disallow: / User-agent: ZoominfoBot Disallow: / User-agent: VelenPublicWebCrawler Disallow: / User-agent: Amazonbot Disallow: / User-agent: GPTBot Disallow: / User-agent: ChatGPT-User Disallow: / User-agent: CCBot Disallow: / User-agent: PerplexityBot Disallow: / User-agent: anthropic-ai Disallow: / User-agent: Claude-Web Disallow: / User-agent: ClaudeBot Disallow: / User-agent: meta-externalagent Disallow: / Crawl-delay: 5 Sitemap: https://topescortsclub.com/sitemap.xml