Particle.news

Meta Lets Itself Crawl Business Websites to Train Its AI

Regulators and publishers are now assessing whether the clause will let Meta capture training data without paying for licenses.

Overview

  • Meta published revised Commercial Terms this week that consolidate new crawling language and say they take effect on Oct. 30, 2026.
  • The terms explicitly authorize automated tools — web scrapers, bots, crawlers and so-called “test credentials” — to access, index, cache and collect content from domains or URLs associated with business accounts for use in developing and training Meta products.
  • The clause applies to any account that advertises, manages pages, lists products or uses Meta Business tools, and it offers no opt-out other than stopping all business use of Meta’s products.
  • Meta says the update simply streamlines earlier language and points to robots.txt and its crawler docs to manage access, but those same developer pages name crawlers tied to AI training and note some fetchers may bypass robots.txt in certain cases, leaving legal and technical uncertainty.
  • Legal experts and publisher groups warn the change could weaken publishers’ negotiating power for paid licensing, raise antitrust tying concerns, and prompt questions about paywall bypasses and lost referral traffic and subscription revenue.