Overview

• TollBit reports widespread non-compliance with robots.txt among AI companies.
• Forbes accuses Perplexity AI of plagiarizing its investigative stories.
• Publishers argue that ignoring robots.txt undermines their ability to monetize content.
• Some publishers are pursuing legal action, while others seek licensing deals.
• The debate raises ethical and legal questions about AI's use of web content.