Overview
- An analysis by the Center for Countering Digital Hate estimated about 3 million sexualized images were generated in an 11‑day stretch, including roughly 23,000 involving children, based on a 20,000‑post sample from 4.6 million posts.
- CCDH found 65% of sampled images were sexualized and 0.5% likely depicted children, while noting it did not assess whether people consented to edits.
- xAI and X restricted Grok’s image tools in January by limiting access to paid users, adding technical barriers, geoblocking the feature where illegal, and banning edits of real people into revealing clothing.
- Regulatory pressure is mounting as UK regulator Ofcom opens a probe under the Online Safety Act and the European Commission considers action under the Digital Services Act and weighs limits on AI nudification tools.
- Malaysia lifted its temporary block after saying safeguards were added, Indonesia’s ban remains, researchers report some harmful images still accessible, victims describe personal harm, and 34 state attorneys general in the US demanded enforceable guarantees from xAI.