Template tokens enable head pruning
Researchers have found that structural template tokens in diffusion transformers act as implicit semantic registers, enabling a training-free head-pruning rule that removes roughly 20% of attention FL…
Researchers have found that structural template tokens in diffusion transformers act as implicit semantic registers, enabling a training-free head-pruning rule that removes roughly 20% of attention FL…
Researchers propose MeanFlow-Transfer (MF-T) and Continuous Adversarial MeanFlow (CAMF) to adapt pretrained diffusion or flow models to new domains with limited data while accelerating sampling. MF-T …
Researchers propose Transformer Transformer, a unified diffusion model that generates complete robot embodiments—every link, joint, motor, and inertial property—optimized for a given manipulation demo…
A developer built a discrete diffusion model for character-level text generation using Andrej Karpathy's Shakespeare dataset, implementing a continuous-time Markov chain (CTMC) with a rate matrix to h…
Researchers propose the Quality Representation Module (QRM), a lightweight transformer module that learns a quality-aware representation to modulate diffusion transformers (DiT) for text-to-image gene…
Krea AI released Krea 2, a series of foundation models for image generation focused on creative exploration, featuring a diffusion transformer architecture and systems for prompt expansion and style r…
Researchers have developed Gamma-World, a multi-agent video world model that can simultaneously generate consistent future observations for multiple independently acting agents sharing the same enviro…
Researchers have developed Diff-Instruct with Diffused Reward (DIDR), a data-free trajectory-level alignment framework that propagates reward-tilted clean-image distributions across all noise levels t…
Slow single-image diffusion model inference is primarily caused by kernel launch overhead and attention memory traffic, not by a lack of computational power. It recommends using `torch.compile` with `…