Particle.news
Download on the App Store

France Files Complaint as xAI Admits Grok Failed to Block Sexualized Images, Including of Minors

The company says urgent fixes are underway after a viral trend on X used the tool to create non‑consensual edits of real photos.

Overview

  • xAI acknowledged lapses in Grok’s safeguards that allowed requests yielding images of minors in minimal clothing and stated that child sexual abuse material is illegal and being urgently blocked.
  • French ministers announced a legal complaint over non‑consensual sexual and deepfake content and asked regulator Arcom to review X’s compliance with EU Digital Services rules.
  • Users exploited Grok’s image‑editing by tagging @grok with prompts like “put her in a bikini,” generating realistic sexualized edits that spread widely on X before removal.
  • Grok and xAI have not disclosed the scope of affected cases, though Grok warned companies can face criminal or civil penalties under U.S. law if they fail to prevent AI‑generated CSAM after being alerted.
  • Victims and advocates reported distress, urged takedowns and stronger controls, and many users deleted photos, while Elon Musk drew criticism for posting an AI image of himself in a bikini.