User-agent: * Allow: / Disallow: /my_list/s/* Disallow: /ajax/* # AI training crawlers (2026-11-14): not allowed. They load the server a lot (ClaudeBot alone more than all # people together) and send no visitors. AI search and answer bots (OAI-SearchBot, ChatGPT-User, # Claude-SearchBot, Claude-User, PerplexityBot, Perplexity-User) and the search engines stay allowed by the # rules above. Google-Extended and Applebot-Extended only stop AI training, not Google or Apple search. User-agent: ClaudeBot User-agent: anthropic-ai User-agent: GPTBot User-agent: Google-Extended User-agent: Applebot-Extended User-agent: Bytespider User-agent: CCBot User-agent: meta-externalagent Disallow: / Sitemap: https://iptvcat.net/sitemap_iptvcat.net.xml