Video diffusion transformers generate high-quality videos, but the quadratic cost of 3D full attention dominates their inference. Dynamic block-sparse attention reduces this cost by computing exact attention only on key/value blocks selected from current activations. However, its fidelity degrades u
Read, Allocate, Route: Role-Coupled Tokenization for Pixel-Space Generative Transformers