Publishers Block AI Crawlers, Reshaping News Data Licensing and AI Strategy

A Reuters Institute review found that by late 2023 many major news sites had blocked AI crawlers, especially OpenAI’s GPTBot.

Some publishers have struck licensing deals with companies like OpenAI and Google, while others still allow access or are taking legal action.

The publisher response is becoming more divided but also more restrictive, with blocking, partnerships, and lawsuits all in play.

These moves could limit AI firms’ access to current journalism and push news content toward paid licensing, attribution, and new monetization rules.