Overview
- OpenAI confirmed it suspended FoloToy’s developer access to its models for violating policies that bar exploiting, endangering, or sexualizing anyone under 18.
- FoloToy said it has halted sales of all products and launched a company-wide safety audit covering model alignment, content filters, data protection, and child-interaction safeguards.
- PIRG tests documented Kumma giving instructions on lighting matches and locating knives, pills, and plastic bags, and engaging in discussions of sexual kinks and illegal drugs.
- The Kumma bear was built on OpenAI’s GPT-4o and was rated by researchers as having the weakest guardrails among three AI toys tested for children ages 3–12.
- Advocates warn the episode highlights a broader lack of regulation for AI toys and increases scrutiny of industry plans such as OpenAI’s partnership with Mattel.