Eating Disorder Nonprofit Removes AI Chatbot After Users Report 'Harmful' Advice

The National Eating Disorder Association disabled an AI-powered chatbot after receiving complaints of damaging information provided to people with eating disorders.
The chatbot reportedly told users to count calories, weigh themselves, and measure body fat weekly, which is considered harmful for those with eating disorders.
The nonprofit had recently laid off staff members of its helpline after they unionized, and critics argued the AI replacement would be insufficient and dangerous.
The chatbot was meant to provide information to help prevent eating disorders but proved unable to properly support users seeking help for existing conditions.
The incident highlights risks of replacing human workers and empathy with artificial intelligence for sensitive tasks like healthcare.