User-agent: * Disallow: /api/ Disallow: /admin/ Disallow: /cart Disallow: /checkout Disallow: /account Disallow: /*?*sort= Disallow: /*?*sort_by= Disallow: /*?*q= Disallow: /*?*attr. # Search and SEO crawlers — same rules as *, throttled User-agent: Claude-SearchBot Crawl-delay: 10 Disallow: /api/ Disallow: /admin/ Disallow: /cart Disallow: /checkout Disallow: /account Disallow: /*?*sort= Disallow: /*?*sort_by= Disallow: /*?*q= Disallow: /*?*attr. User-agent: Amzn-SearchBot Crawl-delay: 10 Disallow: /api/ Disallow: /admin/ Disallow: /cart Disallow: /checkout Disallow: /account Disallow: /*?*sort= Disallow: /*?*sort_by= Disallow: /*?*q= Disallow: /*?*attr. User-agent: SemrushBot Crawl-delay: 10 Disallow: /api/ Disallow: /admin/ Disallow: /cart Disallow: /checkout Disallow: /account Disallow: /*?*sort= Disallow: /*?*sort_by= Disallow: /*?*q= Disallow: /*?*attr. User-agent: AhrefsBot Crawl-delay: 10 Disallow: /api/ Disallow: /admin/ Disallow: /cart Disallow: /checkout Disallow: /account Disallow: /*?*sort= Disallow: /*?*sort_by= Disallow: /*?*q= Disallow: /*?*attr. User-agent: DotBot Crawl-delay: 10 Disallow: /api/ Disallow: /admin/ Disallow: /cart Disallow: /checkout Disallow: /account Disallow: /*?*sort= Disallow: /*?*sort_by= Disallow: /*?*q= Disallow: /*?*attr. User-agent: KeenableBot Crawl-delay: 10 Disallow: /api/ Disallow: /admin/ Disallow: /cart Disallow: /checkout Disallow: /account Disallow: /*?*sort= Disallow: /*?*sort_by= Disallow: /*?*q= Disallow: /*?*attr. # AI/LLM crawlers — content paths allowed, parameterized crawl blocked + throttled User-agent: GPTBot Crawl-delay: 30 Disallow: /*? Disallow: /api/ Disallow: /admin/ Disallow: /cart Disallow: /checkout Disallow: /account User-agent: ChatGPT-User Crawl-delay: 30 Disallow: /*? Disallow: /api/ Disallow: /admin/ Disallow: /cart Disallow: /checkout Disallow: /account User-agent: OAI-SearchBot Crawl-delay: 30 Disallow: /*? Disallow: /api/ Disallow: /admin/ Disallow: /cart Disallow: /checkout Disallow: /account User-agent: CCBot Crawl-delay: 30 Disallow: /*? Disallow: /api/ Disallow: /admin/ Disallow: /cart Disallow: /checkout Disallow: /account User-agent: ClaudeBot Crawl-delay: 30 Disallow: /*? Disallow: /api/ Disallow: /admin/ Disallow: /cart Disallow: /checkout Disallow: /account User-agent: anthropic-ai Crawl-delay: 30 Disallow: /*? Disallow: /api/ Disallow: /admin/ Disallow: /cart Disallow: /checkout Disallow: /account User-agent: PerplexityBot Crawl-delay: 30 Disallow: /*? Disallow: /api/ Disallow: /admin/ Disallow: /cart Disallow: /checkout Disallow: /account User-agent: Bytespider Crawl-delay: 30 Disallow: /*? Disallow: /api/ Disallow: /admin/ Disallow: /cart Disallow: /checkout Disallow: /account User-agent: Amazonbot Crawl-delay: 30 Disallow: /*? Disallow: /api/ Disallow: /admin/ Disallow: /cart Disallow: /checkout Disallow: /account User-agent: meta-externalagent Crawl-delay: 30 Disallow: /*? Disallow: /api/ Disallow: /admin/ Disallow: /cart Disallow: /checkout Disallow: /account User-agent: meta-webindexer Crawl-delay: 30 Disallow: /*? Disallow: /api/ Disallow: /admin/ Disallow: /cart Disallow: /checkout Disallow: /account Sitemap: https://jonkopingssodra.se/sitemap.xml