Holo4D: Holistic 4D Reconstruction as Geometric Control for Video Diffusion

Researchers introduced Holo4D, a method that uses holistic 4D reconstruction as geometric control for video diffusion, addressing the problem of synthesizing a monocular video from a new camera trajectory while preserving observed scene geometry and motion and completing newly visible regions. The approach combines feed-forward 4D reconstructors, which recover the structure of the observed scene, with video diffusion models that supply generative priors. The work targets the gap between reconstruction and generation for novel-view video synthesis.

Synthesizing a monocular video from a new camera trajectory requires preserving the observed scene geometry and motion while completing regions that become newly visible. Feed-forward 4D reconstructors recover the structure of the observed scene, whereas video diffusion models provide a generative p