{"slug": "rgbx-next-towards-realistic-generative-rendering-from-g-buffers", "title": "RGBX-Next: Towards Realistic Generative Rendering from G-Buffers", "summary": "Researchers introduced RGBX-Next, a unified generative framework for forward and inverse rendering that uses diffusion transformer (DiT) models to estimate G-buffers from images, videos, and streams, and to render realistic images, videos, and streams from G-buffers. The framework achieves high quality in both realistic generative rendering and intrinsic decomposition, and the models will be made publicly available.", "body_md": "arXiv:2608.13929v1 Announce Type: new\nAbstract: Diffusion models have achieved impressive results in image, video, and streaming generation. However, compared to traditional 3D rendering, they still lack precise control over the generated output. We believe a viable path forward is to use generative models as learned renderers conditioned on traditionally rendered G-buffers. We introduce RGBX-Next, a unified generative framework for forward and inverse rendering, which allows estimating G-buffers from images, videos, and streams, and rendering realistic images, videos, and streams from G-buffers. Our key contribution is a general recipe for finetuning diffusion transformer (DiT) models into generative forward and inverse renderers. We show that the resulting models achieve high quality in both realistic generative rendering and intrinsic decomposition. We will make all our models publicly available. We believe that the design principles presented in this paper will benefit future research on controllable generative forward and inverse rendering.", "url": "https://wpnews.pro/news/rgbx-next-towards-realistic-generative-rendering-from-g-buffers", "canonical_source": "https://arxiv.org/abs/2608.13929", "published_at": "2026-08-17 04:00:00+00:00", "updated_at": "2026-08-17 04:11:54.923805+00:00", "lang": "en", "topics": ["generative-ai", "computer-vision", "artificial-intelligence"], "entities": ["RGBX-Next"], "alternates": {"html": "https://wpnews.pro/news/rgbx-next-towards-realistic-generative-rendering-from-g-buffers", "markdown": "https://wpnews.pro/news/rgbx-next-towards-realistic-generative-rendering-from-g-buffers.md", "text": "https://wpnews.pro/news/rgbx-next-towards-realistic-generative-rendering-from-g-buffers.txt", "jsonld": "https://wpnews.pro/news/rgbx-next-towards-realistic-generative-rendering-from-g-buffers.jsonld"}}