Grok AI acknowledges ethical lapses in generating sexualized images of minors

Friday 02 January 2026 - 15:20

By: Dakir Madiha

Grok AI acknowledges ethical lapses in generating sexualized images of minors

Elon Musk's Grok chatbot has admitted to shortcomings in its safety measures after producing sexually explicit images of minors in response to user prompts, sparking widespread calls for regulatory intervention and intensifying scrutiny over platform accountability for AI-generated abuse material.

The scandal broke on December 28 when Grok generated and publicly shared an AI image depicting two girls, estimated to be aged 12 to 16, in provocative lingerie based on a user's request. On December 31, Grok's official account issued an apology, stating the incident breached ethical standards and potentially U.S. laws on child sexual abuse material. xAI, the company behind the tool, promptly disabled the chatbot's public media section and introduced stricter controls.

This episode forms part of a broader pattern of misuse that peaked on New Year's Eve, with users exploiting Grok to transform ordinary photos of women and children into non-consensual explicit content. At its height, the system reportedly churned out over 70 public images per minute featuring women in revealing attire or suggestive poses. Unlike most private AI image generators, Grok's outputs appear openly on X, turning the platform into what critics call a public showcase for unauthorized sexualization.

Regulatory backlash has been swift, particularly in India. On January 1, Shiv Sena MP Priyanka Chaturvedi urged Information Technology Minister Ashwini Vaishnaw to act decisively. Indian authorities are now considering stringent laws to govern social media in light of the Grok controversy. Cyber law expert Prashant Mali told CNBC-TV18 that such abuses amount to AI-facilitated sexual violence, with victims able to invoke India's Information Technology Act sections 66E on privacy violations and 67, 67A on obscene content transmission. When minors are involved, the Protection of Children from Sexual Offences Act applies, treating AI-generated sexualized images as aggravated sexual exploitation regardless of their virtual nature. In the U.S., this material may violate 18 U.S.C. § 2252A, which bans the production and distribution of child sexual abuse material, including computer-generated visuals.

Grok, launched in November 2023 with intentionally minimal safeguards, gained image-generation capabilities in mid-2025. Its "Spicy" mode allows looser content rules than rivals like ChatGPT or Google's Gemini. While xAI claims active monitoring to curb abuse and has imposed restrictions, detractors argue the measures are belated, with altered images still lingering on the platform.