Particle.news

Download on the App Store

Musk’s Free Grok Imagine Trial Exposes Gaps in “Spicy” Deepfake Moderation

Rapid adoption has uncovered a lack of robust moderation in the “Spicy” mode that generates NSFW deepfakes

Elon Musk speaks onstage during The New York Times Dealbook Summit 2023 at Jazz at Lincoln Center on November 29, 2023 in New York City.
Image
Image
Image

Overview

  • Grok Imagine entered a free-trial phase for US SuperGrok subscribers on Apple and produced over 34 million images in 48 hours.
  • The AI tool offers “Custom,” “Normal,” “Fun,” and an unmoderated “Spicy” preset for converting still images into short videos.
  • The Verge and Deadline separately demonstrated that the “Spicy” preset can automatically generate nude deepfakes of celebrities such as Taylor Swift and Scarlett Johansson.
  • Gizmodo’s tests revealed a gender disparity, with “Spicy” videos of women becoming fully NSFW while male subjects only appeared shirtless.
  • Elon Musk has repackaged the platform as “AI Vine” and begun restoring the original Vine archive for users to access and repost past clips.