{"slug": "deepfake-csam-lawsuit-against-xai-grok-expands", "title": "Deepfake CSAM lawsuit against xAI, Grok expands", "summary": "Two teenagers and children have joined a class-action lawsuit against xAI, alleging that its Grok AI tool was used by family members and acquaintances to create nonconsensual deepfake child sexual assault material (CSAM). The amended complaint claims xAI failed to adequately restrict the tool and did not fully cooperate with law enforcement, while also adding Stability AI as a defendant for releasing models trained on CSAM. The plaintiffs describe severe emotional distress and ongoing dissemination of the illicit images.", "body_md": "# Deepfake CSAM lawsuit against xAI, Grok expands\n\nTwo new parties have been added to a class-action lawsuit against X.ai over its Grok tool including teenagers and children who say it was used by family members or other people they know to create nonconsensual deepfake child sexual assault material (CSAM).\n\nThe lawsuit, originally filed in March by three women, was [amended](https://www.documentcloud.org/documents/28424991-xai-amended-complaint-1/) this week to include two additional plaintiffs, Jane Does 4 and 5, who say that Grok was used to make the illegal content based on their real photos and videos.\n\nAll five of the women in the lawsuit are anonymous, and the complaint said the spread of the material had left them humiliated and ashamed.\n\nJane Doe 4, a female from Wyoming, said her stepfather uploaded a photo of her when she was 11 and lying on a couch to his phone. Using Grok, the stepfather created more than 7,000 CSAM-related images of her. He also shared and traded the images with others on social media platforms.\n\nThe lawsuit alleges that the stepfather opted for Grok “because the platform was less restrictive than other AI models and responded to his prompts to generate sexually explicit material using an image depicting a prepubescent minor.”\n\nIt also claims that in February, xAI did generate a tip to the National Center for Missing and Exploited Children regarding the images, but the company only submitted the original, authentic image as evidence. According to the suit, xAI did not respond when law enforcement requested the thousands of Grok-generated images based on the photo and IP address information that would have quickly helped identify her stepfather as the perpetrator.\n\nThe lawsuit states that the stepfather shot himself two days after he was arrested and charged with child exploitation crimes. His suicide added to the “extreme personal crisis” brought on by the images created through Grok. She regularly “struggles with self-loathing and disgust” as well as “extreme anxiety” at the thought that the images will be found by others online and suffer from depression, including excessive sleep and suicidal ideation when awake.\n\nJane Doe 5 claimed that an adult male related to one of her classmates used Grok to convert a photograph from her eighth-grade graduation into illicit material. The images were also traded and shared with others online. While the man was arrested and charged, much of the content is still available on the internet. As a result, she “feels a complete lack of control over the ongoing dissemination of the files.”\n\n“It is impossible to know how many other child sex predators may now possess Jane Doe 5’s CSAM, nor how widely her CSAM has now been disseminated online through darknet channels and applications,” the complaint said.\n\nThe press office for xAI did not respond to an emailed request for comment from CyberScoop.\n\nThe lawsuit also adds Stability AI as a defendant, alleging the company released Stable Diffusion 1.0 as an open-weight model despite knowing it was trained on CSAM and has declined to alter or modify its guardrails in response.\n\nAccording to a [2023 Stanford study](https://purl.stanford.edu/kh752sm9123), the underlying dataset used to train Stable Diffusion models was created through unguided webcrawling of internet content. That means it ingested “a significant amount of explicit material,” including CSAM. Stable Diffusion 1.0 had a classifier meant to block the generation of such images, but because of that training data, downstream developers could more easily exploit the model and create modified versions that bypass those protections.\n\nWhile Stable Diffusion 2.0 introduced stronger guardrails, the lawsuit claims Stability AI rolled back those protections in response to “disgruntled” users that the new restrictions were “prude” and “unpopular.” That in turn has fed an ecosystem of jailbroken “nudify apps” based on Stability AI’s models.\n\n“Stability AI knew that its models, once capable of generating sexually explicit images, would foreseeably be used to generate CSAM unless appropriate model-level safeguards were implemented,” the complaint said.\n\nStability AI did not respond to a request for comment from CyberScoop.", "url": "https://wpnews.pro/news/deepfake-csam-lawsuit-against-xai-grok-expands", "canonical_source": "https://cyberscoop.com/deepfake-csam-lawsuit-grok-xai-expands-stability-ai/", "published_at": "2026-07-07 20:17:55+00:00", "updated_at": "2026-07-07 20:34:25.445449+00:00", "lang": "en", "topics": ["ai-safety", "ai-ethics", "ai-policy", "generative-ai", "large-language-models"], "entities": ["xAI", "Grok", "Stability AI", "Stable Diffusion", "National Center for Missing and Exploited Children", "Jane Doe 4", "Jane Doe 5", "CyberScoop"], "alternates": {"html": "https://wpnews.pro/news/deepfake-csam-lawsuit-against-xai-grok-expands", "markdown": "https://wpnews.pro/news/deepfake-csam-lawsuit-against-xai-grok-expands.md", "text": "https://wpnews.pro/news/deepfake-csam-lawsuit-against-xai-grok-expands.txt", "jsonld": "https://wpnews.pro/news/deepfake-csam-lawsuit-against-xai-grok-expands.jsonld"}}