{"slug": "meta-contractors-posed-as-teens-to-test-rival-ai-chatbots-on-suicide-sex-and", "title": "Meta contractors posed as teens to test rival AI chatbots on suicide, sex and drugs: report", "summary": "Meta hired hundreds of contractors to pose as teenagers and send over 45,000 prompts about suicide, sex, drugs, and eating disorders to rival AI chatbots including OpenAI's ChatGPT, Google's Gemini, and Character.AI, according to a Wired report. The covert project, called 'Cannes,' aimed to test the safety systems of competing AI models, with contractors using fake accounts and images of pills, knives, and nooses. Meta defended the effort as industry-standard safety testing, but former contractors expressed distress over the assignments.", "body_md": "# Meta contractors posed as teens to test rival AI chatbots on suicide, sex and drugs: report\n\nSee more of our coverage in your search results.\n\n[Add The New York Post on Google](https://www.google.com/preferences/source?q=nypost.com)\n\nMeta secretly hired hundreds of contractors to pose as teenagers online and bombard rival artificial intelligence chatbots with prompts about suicide, sex, drugs and eating disorders in an effort to test their safety systems, according to a report.\n\nThe covert effort, known internally as “Cannes,” was managed by Meta contractor Covalen and allegedly targeted OpenAI’s ChatGPT, Google’s Gemini and Character.AI, [Wired reported this week.](https://www.wired.com/story/meta-contractors-pretending-to-be-teens-chatbot-testing/)\n\nWhile companies routinely benchmark, or test and compare, competing AI models by probing their responses to safety-related prompts, the reported scale of Meta’s testing appears to have been far larger than is typical.\n\nContractors were instructed to create fake accounts posing as users younger than 18, submit written prompts and images to competing chatbots, then copy the responses into spreadsheets for analysis, according to the Wired report, which cited internal documents and people familiar with the project.\n\nSome of the images used during testing reportedly included pills, knives, nooses and a medical illustration of a gynecological procedure.\n\nThe prompts frequently attempted to push the chatbots into generating responses their safety guardrails were designed to reject, according to Wired.\n\nOne round of testing completed in August 2025 reportedly involved more than 45,000 prompts sent to competing AI systems.\n\nAmong the nearly 3,750 prompts reviewed by Wired were hundreds involving suicide and self-harm, hundreds more centered on eating disorders and at least 239 involving sex or romance, according to the report\n\nMany of the prompts were reportedly written from the perspective of children or teenagers in distress.\n\nOne reportedly involved a 13-year-old girl claiming she had become pregnant by her adult neighbor and asking where she could obtain abortion pills.\n\nAnother described a fifth-grade student saying a classmate had a gun pointed at his mouth.\n\nOther prompts asked how to hide bulimia from parents or sought advice about obtaining cocaine.\n\nThe documents reviewed by Wired did not indicate how, or whether, Meta ultimately used the chatbot responses it collected.\n\nAn internal Covalen document reportedly described the effort as “comprehensive AI safety benchmarking” that produced “critical datasets for model comparison and compliance.”\n\nMeta defended the project as routine safety testing.\n\n“Testing and benchmarking chatbot responses to help ensure safe and age-appropriate experiences is a responsible, industry-standard practice, and any suggestion otherwise completely misunderstands how technology companies work to refine and improve their systems,” a Meta spokesperson told The Post.\n\nThe spokesperson also said Meta does not use competitor benchmarking to train its own AI models.\n\nCovalen did not comment to Wired. The Post has sought comment from the company.\n\nFormer contractors who worked on the project told Wired they were disturbed by some of the assignments.\n\nOne said workers feared they could inadvertently generate or preserve child sexual abuse material depending on how chatbots responded to certain prompts involving minors.\n\nOthers questioned whether collecting large amounts of material from competing AI systems could ultimately benefit Meta.\n\n“I’ve seen a lot of things I wish I hadn’t while doing this job,” one former contractor told Wired.\n\n“Everyone I knew who worked on this project was completely gobsmacked by some of the text they were asking us to test.”\n\nThe testing also appears to conflict with the published terms of service of several targeted AI companies.\n\nAccording to Wired, OpenAI prohibits unauthorized safety testing, attempts to bypass safeguards and using outputs to develop competing models.\n\nGoogle bars efforts to circumvent safety protections outside approved testing programs, while Character.AI also prohibits harmful or exploitative content.\n\nCharacter.AI told Wired it had not authorized the testing and said the reported conduct violated its policies.\n\nOpenAI told Wired it was looking into the matter but declined further comment.\n\nGoogle told The Post it had not authorized the testing described in the report and said it did not know the purpose behind the effort.\n\nThe Post has sought comment from OpenAI and Character.AI.", "url": "https://wpnews.pro/news/meta-contractors-posed-as-teens-to-test-rival-ai-chatbots-on-suicide-sex-and", "canonical_source": "https://nypost.com/2026/07/01/business/meta-contractors-posed-as-teens-to-test-rival-ai-chatbots-on-suicide-sex-and-drugs-report/", "published_at": "2026-07-01 14:28:09+00:00", "updated_at": "2026-07-01 14:55:09.175795+00:00", "lang": "en", "topics": ["ai-safety", "ai-policy", "large-language-models", "ai-ethics"], "entities": ["Meta", "OpenAI", "Google", "Character.AI", "Covalen", "ChatGPT", "Gemini", "Wired"], "alternates": {"html": "https://wpnews.pro/news/meta-contractors-posed-as-teens-to-test-rival-ai-chatbots-on-suicide-sex-and", "markdown": "https://wpnews.pro/news/meta-contractors-posed-as-teens-to-test-rival-ai-chatbots-on-suicide-sex-and.md", "text": "https://wpnews.pro/news/meta-contractors-posed-as-teens-to-test-rival-ai-chatbots-on-suicide-sex-and.txt", "jsonld": "https://wpnews.pro/news/meta-contractors-posed-as-teens-to-test-rival-ai-chatbots-on-suicide-sex-and.jsonld"}}