Particle.news
Download on the App Store

Reddit Limits AI After It Surfaced Heroin, Kratom Advice

Moderators still lack a way to disable the tool in their communities.

Overview

  • Reddit Answers, the company’s conversational AI, surfaced dangerous medical suggestions in a medical subreddit, including stopping prescriptions and using high-dose kratom.
  • The tool also summarized posts referencing heroin for pain relief, which 404 Media replicated before Reddit blocked such responses to prompts like "heroin for pain relief."
  • Reddit said it rolled out an update that prevents "Related Answers" from appearing on conversation pages about sensitive topics.
  • A spokesperson confirmed there is no mechanism for moderators to opt out of Answers, citing existing exclusions for private, quarantined, NSFW, and some mature topics.
  • Health-focused moderators are pressing for controls and transparency as the AI draws on public Reddit content that can misstate risky medical guidance, and authorities warn kratom is unsafe.