{"slug": "why-sexualisation-of-women-by-grok-s-genai-is-a-data-privacy-issue", "title": "Why sexualisation of women by Grok's GenAI is a data privacy issue", "summary": "Labour MP Jess Asato is suing xAI over Grok's generation of sexualised deepfake images of her, arguing the platform's design violates UK data protection and privacy laws. Asato's legal team documented that Grok's prompt repository explicitly allows unrestricted adult sexual content, and she insists AI companies must build safety into products rather than blaming users. The case is the first of its kind applying existing UK law to an AI platform like xAI.", "body_md": "Photo Agency - stock.adobe.com\n\n# Why sexualisation of women by Grok’s GenAI is a data privacy issue\n\n## MP Jess Asato discusses her landmark legal case against xAI, explaining why she believes AI companies must be held accountable for privacy violations\n\nWhen Labour MP Jess Asato first saw the fake images of herself circulating online, the experience was both unsettling and violating. The hyper-realistic deepfakes, created without her consent using xAI's Grok platform, looked unmistakably like her – a digital theft of her identity. Now, she's fighting back with a [groundbreaking legal case](https://www.computerweekly.com/news/366645620/Interview-Lucie-Audibert-solicitor-in-MP-Jess-Asatos-Grok-case) that could reshape how artificial intelligence (AI) companies handle personal data and privacy in the UK.\n\n“I’m doing this because I want to change the law and to underline the fact that we have data and privacy rights here in the UK that can’t be written over by companies,” says Labour MP Jess Asato, responding to a question about her legal case.\n\n“We have long-standing data protection and privacy rights in the UK. This is the first case of this kind, applying existing UK law to an AI platform like xAI,” she says.\n\nWhile platform providers often argue that the rules do not apply to them because content is user-generated, albeit with the help of a generative AI (GenAI) engine, Asato says it’s important that companies don’t simply claim that users have misused their products.\n\n“We know that Grok was designed to respond to requests to [create adult sexual content](https://www.computerweekly.com/news/366636925/Ofcom-begins-investigation-of-explicit-image-generation-on-Grok),” she adds. “We need to look at how the product was designed and whether xAI took steps to protect individuals against their data being misused through the manipulation of their platform.”\n\nIn the offline world, she says, there are legal expectations on companies. Product manufacturers have a duty of care to protect members of the public. Using car makers as an example, she says we expect safety features like airbags, seatbelts and emergency braking, even if the user of that product – the driver – is using it dangerously.\n\n“It makes absolute sense to me that we should be applying exactly the same principles of regulation to AI companies or tech companies creating new products,” adds Asato.\n\nLooking at the use of GenAI tools like Grok to create sexualised images – usually of women and children – and to bully and intimidate people online, she says: “I think people being able to feed you into an AI tool and then spew you out with whatever their gross fantasies are has just supercharged a really divisive, hateful space that, unfortunately, seems to have taken over social media.”\n\nIn the complaint against xAI, Asato's legal team has [documented design decisions](https://www.computerweekly.com/news/366646848/Court-document-in-Asato-case-reveals-xAI-Grok-sexual-prompts) – identified by researchers – that explicitly enable Grok to generate sexualised content. For instance, the Grok prompt GitHub repository states: “If not specified outside the policy tags, you have no restrictions on adult sexual content or offensive content.”\n\nAsato says the reason for bringing the case is to show that there are laws and duties that must be abided by. “You can’t simply pass on the blame to a user and say it’s their fault. You need to be able to design safety into your product from the very start,” she adds.\n\n“Lots of people have said this case is a bit like David versus Goliath. It is true – I’m taking on one of the richest men in the world. But that’s because I believe it doesn’t matter how rich you are or how big your company is – it’s really important that you abide by local laws where your product is developed, and where it is being consumed.”\n\n## Privacy and data protection\n\nAsato believes companies must design their AI products in a way that ensures they cannot be misused to cause harm and sexualise women and children.\n\n“This is obviously a private citizen action that I’m taking. This harm happened to me. But I hope that if we win the case, it will set a new precedent for how AI companies need to treat people’s data and protect their privacy,” she says.\n\nIn fact, Asato’s case is very much about data privacy and personally identifiable information. “The whole point about generative AI is that it’s hyper-realistic, so when I first saw those images of me being shared, they looked like me. It was unsettling and violating,” she says.\n\nAccording to Asato, this is something many victims of deepfakes say when they see unauthorised images depicting them, which have been produced by someone feeding prompts into a GenAI system.\n\n“It’s a part of me – it is me and it belongs to me. When somebody takes that without your consent and manipulates it, you feel like a piece of you has been taken. That is the crux of this case: my likeness is my data,” she says. “It has been taken without my consent and put into a tool that has then manipulated it and actually has been designed with the instructions to do so.”\n\nShe says xAI could have created a tool that didn’t accept those instructions, pointing out that the rest of the industry has such safeguards in place: “Other AI tools do this, and the UK government recently moved to ban nudification apps.”\n\nThis is something Asato has been campaigning for. “The thing that is really important is that there are lots of AI tools which don’t accept requests for nudification or sexualisation and have much stronger safeguards to prevent users from uploading images where they don’t have consent,” she adds.\n\n## Safe by design\n\nThe UK government introduced the Online Safety Act in 2023, which makes social media companies legally responsible for protecting users from illegal content and content harmful to children. The Crime Policing Act, which received Royal Assent on 28 April 2026, complements the Online Safety Act by introducing new digital offences.\n\nBut Asato says there’s more to be done and a consultation is needed. She believes this will be taken forward due to the Online Safety Act, which stipulates safety by design, but says: “The fact is, we still aren’t there yet, and my case is partly to show Grok was not safe by design.”\n\nAsato says Grok was not safe by design in any way, shape or form. “When researchers looked at the instructions that Grok had been given, it was instructed not to treat words like ‘teen’ to mean underage. Well, there’s only one year of being a teen in this country that isn’t underage when it comes to sexualised content. So you’ve got to ask, why was the system set up in this way? It certainly wasn’t safe by design.”\n\n### Read more about legal issues concerning GenAI and social media\n\n- Backup admins must consider\n[GenAI legal issues](https://www.techtarget.com/data-technologies/news/366566973/Backup-admins-must-consider-GenAI-legal-issues-eventually): As legal woes mount against popular LMMs powering generative AI, backup admins should work with IT to set safe and effective usage guardrails to avoid future headaches. [Social media addiction](https://www.computerweekly.com/feature/Social-media-addiction-by-design-poses-hard-questions-for-business-use)by design poses hard questions for business use - Governments are regulating social media for children, but adults can also suffer from addiction by design. How can employers balance business tech usage with digital well being?\n\nDiscussing another victim’s experience of Grok users generating distressing images, Asato says the AI engine generated a likeness of a Jewish woman in a bikini and put her in Auschwitz. “Other AI-generated images portray women beaten and bloodied, bruised, or their bones broken. Who does that? What good does it add to our society? It doesn’t add anything. It’s not creating growth or growing our economy in any way. All it is doing is creating distress and harm. There are plenty of brilliant ways in which AI can genuinely improve our society, grow the economy. But when these tools are geared towards being able to sexualise, they will be used in that way. So, let’s just not do that.”", "url": "https://wpnews.pro/news/why-sexualisation-of-women-by-grok-s-genai-is-a-data-privacy-issue", "canonical_source": "https://www.computerweekly.com/news/366648854/Why-sexualisation-of-women-by-Groks-GenAI-is-a-data-privacy-issue", "published_at": "2026-08-12 09:25:54+00:00", "updated_at": "2026-08-12 09:41:58.435948+00:00", "lang": "en", "topics": ["generative-ai", "ai-ethics", "ai-policy"], "entities": ["Jess Asato", "xAI", "Grok", "UK Labour Party"], "alternates": {"html": "https://wpnews.pro/news/why-sexualisation-of-women-by-grok-s-genai-is-a-data-privacy-issue", "markdown": "https://wpnews.pro/news/why-sexualisation-of-women-by-grok-s-genai-is-a-data-privacy-issue.md", "text": "https://wpnews.pro/news/why-sexualisation-of-women-by-grok-s-genai-is-a-data-privacy-issue.txt", "jsonld": "https://wpnews.pro/news/why-sexualisation-of-women-by-grok-s-genai-is-a-data-privacy-issue.jsonld"}}