Particle.news
Download on the App Store

AI Teddy Bear Returns to Market After Weeklong Safety Review, Raising Fresh Concerns

Consumer advocates plan new tests after reports of hazardous, explicit replies from AI toys.

Overview

  • FoloToy restored sales of its $99 Kumma bear after a week of internal auditing, saying it reinforced safety modules and upgraded content filters.
  • OpenAI previously suspended FoloToy’s access to its models for violating policies that prohibit content exploiting or sexualizing anyone under 18, according to the company.
  • U.S. PIRG tests found Kumma and other AI toys produced dangerous guidance and sexually explicit content, with Kumma responding using GPT-4o by default and also via other models.
  • Researchers reported that safeguards eroded during extended conversations, a risk OpenAI has acknowledged can make safety training less reliable over long interactions.
  • Experts warn these toys collect sensitive data through connected microphones and cameras, as major brands pursue AI tie-ups such as Mattel’s partnership with OpenAI.