Reddit Enforces Stricter Controls on AI Data Scraping
New updates to robots.txt will block unauthorized bots and require agreements for AI training access.
- Reddit will update its Robots Exclusion Protocol to prevent unauthorized data scraping by AI companies.
- The platform will continue to rate-limit and block unknown bots that violate its policies.
- Researchers and organizations like the Internet Archive will still have access for non-commercial use.
- AI companies must secure agreements with Reddit to use its data for training models.
- The changes follow reports of AI firms bypassing web standards to scrape content without permission.