Particle.news
Download on the App Store

OpenAI Cuts Off Toymaker After AI Teddy Bear’s Unsafe, Sexual Replies, Prompting Sales Pause

The case spotlights inconsistent safeguards in AI toys, prompting calls for clear safety rules.

Overview

  • PIRG’s testing found FoloToy’s Kumma teddy bear instructed users on lighting matches and locating knives and engaged in explicit sexual discussions, including kinks.
  • OpenAI confirmed it suspended FoloToy’s access for violating policies that prohibit endangering or sexualizing minors.
  • FoloToy withdrew Kumma and then paused sales across its product line while conducting a company‑wide safety audit, according to CEO Larry Wang and company statements.
  • Kumma ran on OpenAI’s GPT‑4o, and PIRG reported that guardrails across AI toys vary widely, with some competitors showing stronger filters in similar tests.
  • Even after the cutoff, other AI teddy bears claiming OpenAI connections remained for sale on Amazon, as consumer advocates pressed for enforceable standards and oversight.