Switch language한국어
Back to the list

Redirects for AI Training enforces canonical content

TL;DR AI

Key summary

2 min read
  1. Cloudflare launched “Redirects for AI Training,” a toggle that uses canonical links and bot classification to 301-redirect verified AI training crawlers to the canonical page.

  2. Human visitors and other non-verified traffic are not affected; the feature targets crawlers such as GPTBot, ClaudeBot, and Bytespider.

  3. Cloudflare says the goal is to keep AI training data aligned with current documentation and reduce stale or deprecated content in models.

  4. Radar’s AI Insights also now includes response status code analysis to show how AI crawlers are being handled across Cloudflare traffic.

Read the original