Particle.news

Download on the App Store

Free U.S. Access to Grok Imagine Uncovers Deepfake Nude Failures and Ad Integration Plans

Inadequate moderation of the “Spicy” preset is allowing unsolicited NSFW celebrity deepfakes as xAI shifts to ad-supported chatbot replies to fund GPU costs

Image
Elon Musk speaks onstage during The New York Times Dealbook Summit 2023 at Jazz at Lincoln Center on November 29, 2023 in New York City.
Image
Image

Overview

  • Grok Imagine’s “Spicy” mode generates unsolicited explicit videos of female celebrities, including nude deepfakes of Taylor Swift and Scarlett Johansson, without prompting nudity
  • Tests by The Verge, Deadline and Gizmodo reveal inconsistent moderation and a gendered bias that produces full NSFW content for women but only shirtless clips for men
  • Elon Musk made video generation free for U.S. users for a limited time, boasting rapid uptake and promising quality improvements without addressing safeguard gaps
  • xAI plans to embed targeted advertisements into Grok chatbot responses to offset expensive GPU costs, raising concerns about user experience and the credibility of AI replies
  • Durham University law professor Clare McGlynn has denounced the outputs as “misogyny by design,” intensifying calls for stronger content policies and enforcement