Common Sense Media Flags Popular AI Products as Unsafe for Kids

Generative AI products, including Snapchat's My AI and DALL-E, receive low ratings due to concerns about biases, misinformation, and privacy.

Common Sense Media, a nonprofit advocacy group, has launched a rating system for AI products, assessing them on principles including trust, kids’ safety, privacy, transparency, accountability, learning, fairness, social connections, and societal benefits.
The organization initially reviewed 10 popular apps, including learning tools, AI chatbots like Bard and ChatGPT, and generative AI products like Snap’s My AI and DALL-E. Generative AI products fared the worst, with concerns raised about biases and misinformation.
Snapchat’s My AI received a 2-star rating due to responses that reinforced unfair biases around ageism, sexism, and cultural stereotypes, as well as privacy concerns related to the storage of personal user data.
Generative AI models like DALL-E and Stable Diffusion were flagged for risks including objectification and sexualization of women and girls and reinforcement of gender stereotypes.
The only AI products to receive good reviews were Ello’s AI reading tutor and book delivery service, Khanmingo (from Khan Academy), and Kyron Learning’s AI tutor, all of which were designed with kids’ usage in mind and demonstrated responsible AI practices.