arXiv:2610.10984v1 Announce Type: new Abstract: We present Fluid-Gen-Zero, a training-free framework for physics-aware fluid-object interaction video generation that decouples physical reasoning from appearance synthesis. Our key insight is to delegate motion dynamics to a physics simulator while preserving the appearance modeling capacity of pretrained video generators. We bridge these two domains through a two-level agentic workflow: generation-time planning, where a vision-language model (VLM) agent interprets intent and the simulation rollout to organize generation clips, and latent-space guidance, which injects simulation signals into denoising through region-aware latent wrapping. This plug-and-play design is compatible with current video foundation models. We further introduce a benchmark for fluid-object interaction video generation. Across Tora (CogVideoX-based), VACE and WanMove (Wan-based), Fluid-Gen-Zero consistently improves simulation alignment, reducing object trajectory error by 26.7%-81.5% and fluid fEPE (fluid flow endpoint error) by 67.9%-84.0%, while largely preserving perceptual quality. In a human preference study, raters favor Fluid-Gen-Zero in 55.1%-74.4% of same-backbone comparisons across three backbones, and in 90.4%-94.2% of comparisons against simulation-based methods. Code and data will be released upon acceptance.
Fluid-Gen-Zero: Grounding Pretrained Video Generators in Physics without Training
Fluid-Gen-Zero, a training-free framework from researchers behind the arXiv:2610.10984v1 paper, grounds pretrained video generators in physics by delegating motion dynamics to a simulator while preserving the appearance modeling of the base models. Across Tora (CogVideoX-based), VACE and WanMove (Wan-based), the framework reduced object trajectory error by 26.7%-81.5% and fluid flow endpoint error (fEPE) by 67.9%-84.0% while largely preserving perceptual quality. In a human preference study, raters favored Fluid-Gen-Zero in 55.1%-74.4% of same-backbone comparisons across three backbones and in 90.4%-94.2% of comparisons against simulation-based methods.
Run your AI side-project on zahid.host
EU-based hosting, git-push deploys, automatic HTTPS, no cold starts. Free tier with a custom domain — perfect for shipping the agent you just read about.