OpenAI web crawler sparks controversy, prompts blocking efforts
- OpenAI launched GPTBot to gather data for future AI models
- Websites can block GPTBot by adding it to robots.txt or blocking IP
- GPTBot filters some content like paywalled, PII, policy-violating text
- ChatGPT usage has declined recently while Bard sees increase
- Scraping practices raise ethics, privacy, and legal concerns
ZDNET 
VentureBeat 
The Messenger 
Fox News 
The Information 
Mashable 
Business Insider 
The Verge 
