cd /news/computer-vision/fusionrelight-relighting-portraits-i… · home topics computer-vision article
[ARTICLE · art-97064] src=research.nvidia.com ↗ pub= topic=computer-vision verified=true sentiment=↑ positive

FusionRelight: Relighting Portraits in Real Time via Hybrid Domain Knowledge Fusion

Researchers from an undisclosed institution introduced Hybrid Domain Knowledge Fusion (HDKF), a relighting-specific training framework that fuses physics, reflectance, and realism priors from synthetic, One-Light-at-a-Time (OLAT), and in-the-wild data to relight portraits in real time. On a held-out OLAT benchmark, HDKF achieved the best MSE, PSNR, and SSIM among evaluated methods while remaining competitive in LPIPS. The distilled model runs at 512x512 resolution, reaching 11.89 ms on an RTX 2060 and 1.82 ms on an RTX 4090.

read1 min views1 publishedAug 14, 2026

Portrait relighting is a low-level vision problem in which physically plausible illumination transfer, identity preservation, and compact real-time inference must be considered together. Iterative diffusion-style methods can synthesize fine detail, but stochastic inference and cost complicate deterministic live video creation; physically grounded relighting preserves identity, but controlled synthetic or light-stage supervision transfers poorly to unconstrained cameras. We present Hybrid Domain Knowledge Fusion (HDKF), a relighting-specific training framework that learns complementary physics, reflectance, and realism priors from synthetic, One-Light-at-A-Time (OLAT), and in-the-wild data, then distills their source-routed supervision into a compact student with clean teacher labels and degraded student inputs. The framework is trained with pixel-aligned RGB, albedo, and normal supervision, providing a simulation substrate for physically grounded low-level relighting. On a held-out OLAT benchmark, HDKF obtains the best MSE, PSNR, and SSIM among evaluated methods while remaining competitive in LPIPS. The distilled model runs in real time at 512x512, reaching 11.89 ms on an RTX 2060 and 1.82 ms on an RTX 4090.

── more in #computer-vision 4 stories · sorted by recency
── more on @hdkf 3 stories trending now
sponsored brought to you by zahid.host 4,200+ EU-deployed projects
reading about agents? ship yours in a single git push.

Run your AI side-project on zahid.host

EU-based hosting, git-push deploys, automatic HTTPS, no cold starts. Free tier with a custom domain — perfect for shipping the agent you just read about.

$git push zahid main
Live at https://your-agent.zahid.host
Get free account → Pricing
from €0/mo · no card required
LIVE [news/fusionrelight-religh…] indexed:0 read:1min 2026-08-14 ·