cd /news/generative-ai/diff-id-identity-consistent-facial-i… · home topics generative-ai article
[ARTICLE · art-78033] src=arxiv.org ↗ pub= topic=generative-ai verified=true sentiment=· neutral

Diff-ID: Identity Consistent Facial Image Generation and Morphing via Diffusion Models

Researchers introduce Diff-ID, a diffusion-based framework that enforces identity consistency in facial image generation while delivering photorealistic quality, using a custom 210K image dataset and integrating ArcFace and CLIP embeddings through a dual cross attention adapter within a fine-tuned Stable Diffusion UNet. The method achieves lower FID and stronger FIQ-based identity-realism trade-off compared to InstantID, though it does not exceed InstantID in raw ArcFace Face Similarity. The team also presents a unified DDIM-based morphing pipeline for facial interpolation without per-identity fine-tuning.

read1 min views1 publishedJul 29, 2026

arXiv:2607.25078v1 Announce Type: new Abstract: Generative diffusion models have revolutionized facial image synthesis, yet robust identity preservation in high resolution outputs remains a critical challenge. This issue is especially vital for security systems, biometric authentication, and privacy sensitive applications, where any drift in identity integrity can undermine trust and functionality. We introduce Diff-ID, a diffusion based framework that enforces identity consistency while delivering photorealistic quality. Central to our approach is a custom 210K image dataset synthesized from CelebA-HQ, FFHQ, and LAION-Face and captioned via a fine tuned BLIP model to bolster identity awareness during training. Diff-ID integrates ArcFace and CLIP embeddings through a dual cross attention adapter within a fine tuned Stable Diffusion UNet. To further reinforce identity fidelity, we propose a pseudo discriminator loss based on ArcFace cosine similarity with exponential timestep weighting. Experiments on held out and unseen faces show that Diff-ID does not exceed InstantID in raw ArcFace Face Similarity, but achieves substantially lower FID and the strongest FIQ based identity--realism trade off among the evaluated methods. We also present a unified DDIM based morphing pipeline that enables qualitative facial interpolation without per identity fine tuning. We further argue that identity preservation and photorealism should be evaluated jointly rather than in isolation, as high identity similarity alone does not guarantee realistic outputs. To make this trade off explicit, we report Face Image Quality (FIQ) as a complementary ratio based score that combines identity similarity and perceptual realism while keeping FS and FID as the primary metrics.

── more in #generative-ai 4 stories · sorted by recency
── more on @diff-id 3 stories trending now
sponsored brought to you by zahid.host 4,200+ EU-deployed projects
reading about agents? ship yours in a single git push.

Run your AI side-project on zahid.host

EU-based hosting, git-push deploys, automatic HTTPS, no cold starts. Free tier with a custom domain — perfect for shipping the agent you just read about.

$git push zahid main
Live at https://your-agent.zahid.host
Get free account → Pricing
from €0/mo · no card required
LIVE [news/diff-id-identity-con…] indexed:0 read:1min 2026-07-29 ·