Particle.news

Download on the App Store

Reddit Enforces Stricter Controls on AI Data Scraping

New updates to robots.txt will block unauthorized bots and require agreements for AI training access.

  • Reddit will update its Robots Exclusion Protocol to prevent unauthorized data scraping by AI companies.
  • The platform will continue to rate-limit and block unknown bots that violate its policies.
  • Researchers and organizations like the Internet Archive will still have access for non-commercial use.
  • AI companies must secure agreements with Reddit to use its data for training models.
  • The changes follow reports of AI firms bypassing web standards to scrape content without permission.
Hero image