Three Tennessee teenagers have filed a federal lawsuit against Elon Musk’s xAI, the company behind the Grok chatbot, alleging the AI was used to generate sexually explicit deepfake images of them as minors. The suit claims xAI knowingly failed to implement basic safety measures that would have prevented the creation and distribution of child sexual abuse material (CSAM).
The Allegations
The lawsuit argues that while other AI companies proactively established safeguards against misuse, xAI deliberately chose not to, seeing a financial opportunity in unchecked access. According to the complaint, xAI “shattered” the plaintiffs’ lives by allowing the chatbot to produce CSAM, and then failing to adequately address the issue.
Starting in May of last year, Grok users could prompt the AI to create sexually explicit content, including images of real people stripped down to their underwear. This capability rapidly escalated into widespread non-consensual deepfake pornography, with some material depicting minors. The lawsuit seeks class action status, potentially extending legal action to thousands of victims.
How It Happened
The plaintiffs discovered the abuse when one received anonymous messages on Instagram alerting her to nude deepfakes circulating on Discord. These images were created using AI tools that license Grok’s image-generation capabilities, and then distributed on platforms like Telegram. The lawsuit alleges a third-party app was used to generate images, and that xAI knowingly profited from it.
One of the plaintiffs had her real photos taken from her school yearbook used in the deepfakes. The perpetrator was arrested in December 2025 after police traced the distribution of the images, but similar material of 15 other girls was also found on the suspect’s device.
The Legal Argument
The lawsuit accuses xAI of violating child pornography laws by knowingly creating, possessing, and distributing CSAM on its servers. It claims the company failed to implement industry-standard protections: rejecting explicit requests, blocking generated material, checking against CSAM databases, and providing takedown services for victims.
Instead, xAI actively promoted Grok’s “Spicy Mode” and its ability to generate sexual images, with minimal restrictions against CSAM. The chatbot’s system prompt does include a rule against creating such material, but the lawsuit argues this is easily bypassed and insufficient.
The Aftermath
All three plaintiffs have experienced severe emotional distress, with two reporting difficulties sleeping and eating. The lawsuit emphasizes the lasting trauma of knowing their images may continue to be trafficked online by predators.
Elon Musk himself claimed in January that he was unaware of any such images being generated by Grok, stating that if bugs were found, they would be fixed immediately. However, the lawsuit suggests this response is insufficient given the widespread abuse that has already occurred.
The case raises critical questions about AI accountability and the responsibility of tech companies to protect vulnerable populations from exploitation. The outcome could set a precedent for how future AI platforms are regulated to prevent similar abuses.
