Switch language한국어
Back to the list

Miasma: A tool to trap AI web scrapers in an endless poison pit | Hacker News

TL;DR AI

Key summary

2 min read
  1. Public websites are having content stolen by web scrapers.

  2. Throttling has been used and discussed as a way to limit scrapers and as a social contract between machines.

  3. A tool named Miasma is described to trap AI web scrapers.

  4. Existing tools rely on throttling to try to limit scraping.

  5. Scraping affects advertising revenue and user attention, and charging licensing fees to AI bots for scraping is mentioned.

Read the original