{"slug": "position-ai-ml-deepfake-research-is-misaligned-with-ai-generated-non-consensual", "title": "Position: AI/ML Deepfake Research is Misaligned with AI-Generated Non-Consensual Intimate Imagery (AIG-NCII)", "summary": "A new position paper from arXiv (2607.18263v1) argues that AI/ML research on deepfakes is misaligned with the dominant reality of generative AI abuse, AI-generated non-consensual intimate imagery (AIG-NCII). The authors conduct a landscape analysis of highly-cited works and find that technical interventions almost entirely ignore AIG-NCII, focusing instead on authenticity detection tools that address viewer-centric epistemic harms but not subject-centric dignity harms. The paper recommends updating threat models and integrating AIG-NCII into AI safety research, while cautioning that researchers must implement safety guardrails and partner with sexual violence prevention experts.", "body_md": "arXiv:2607.18263v1 Announce Type: new\nAbstract: AI-generated non-consensual intimate imagery (AIG-NCII) is not adequately addressed in AI/ML literature regarding AI-generated media, commonly referred to as \"deepfakes\". While research on deepfakes currently focuses on its epistemic harms -- or harms relating to truth and authenticity -- this is misaligned with the dominant reality of generative AI abuse involving sexualized imagery. We conduct a landscape analysis of highly-cited works to demonstrate that technical interventions addressing deepfakes almost entirely ignore AIG-NCII, limiting the research ecosystem to authenticity detection tools. In this position paper, we argue that existing interventions address viewer-centric epistemic harms, such as fraud or scams, but ignore subject-centric dignity harms, such as AIG-NCII. We illustrate that knowing an image is synthetic does not mitigate harms to subjects and may, in some cases, even exacerbate them. We conclude by offering recommendations to realign the field, including updating threat models to consider subject-centric harms and addressing AIG-NCII in AI safety research. Finally, we caution that researchers should only engage in this high-risk domain if they implement safety guardrails for both subjects and researchers and establish partnerships with domain experts in sexual violence prevention.", "url": "https://wpnews.pro/news/position-ai-ml-deepfake-research-is-misaligned-with-ai-generated-non-consensual", "canonical_source": "https://arxiv.org/abs/2607.18263", "published_at": "2026-07-22 04:00:00+00:00", "updated_at": "2026-07-22 04:12:51.378082+00:00", "lang": "en", "topics": ["artificial-intelligence", "ai-ethics", "ai-safety", "ai-research"], "entities": ["arXiv"], "alternates": {"html": "https://wpnews.pro/news/position-ai-ml-deepfake-research-is-misaligned-with-ai-generated-non-consensual", "markdown": "https://wpnews.pro/news/position-ai-ml-deepfake-research-is-misaligned-with-ai-generated-non-consensual.md", "text": "https://wpnews.pro/news/position-ai-ml-deepfake-research-is-misaligned-with-ai-generated-non-consensual.txt", "jsonld": "https://wpnews.pro/news/position-ai-ml-deepfake-research-is-misaligned-with-ai-generated-non-consensual.jsonld"}}