cd /news/artificial-intelligence/starflow2-bridging-language-models-a… · home topics artificial-intelligence article
[ARTICLE · art-110302] src=machinelearning.apple.com ↗ pub= topic=artificial-intelligence verified=true sentiment=↑ positive

STARFlow2: Bridging Language Models and Normalizing Flows for Unified Multimodal Generation

Researchers from UIUC and Apple introduced STARFlow2, a unified multimodal model built on the Pretzel architecture that interleaves a frozen pretrained vision-language model with a TARFlow stream via residual skip connections under a single causal mask, enabling continuous, single-pass, and purely causal generation of interleaved text and images. The model preserves pretrained multimodal understanding while achieving high-fidelity image generation, and experiments show strong performance on image generation and multimodal understanding benchmarks.

read1 min views1 publishedAug 25, 2026
STARFlow2: Bridging Language Models and Normalizing Flows for Unified Multimodal Generation
Image: Apple ML Research

Unified multimodal models that understand, reason over, and generate interleaved text–image sequences remain structurally fragmented: existing approaches either sacrifice visual fidelity through discrete tokenization, impose structural asymmetry by combining causal text generation with iterative diffusion-based denoising, or degrade pretrained understanding when adapting vision-language models for generation. We observe that autoregressive normalizing flows are autoregressive Transformers—sharing the same causal mask, KV-cache mechanism, and left-to-right structure as LLMs—making them the most natural paradigm for truly unified multimodal generation that is continuous, single-pass, and purely causal. We present STARFlow2, built on the Pretzel architecture that vertically interleaves a frozen pretrained VLM stream with a TARFlow stream via residual skip connections, both operating under the same causal mask. This design simultaneously preserves pretrained multimodal understanding, enables high-fidelity continuous image generation, and achieves structural unification under a single causal mechanism. Combined with a deep-shallow flow design and a unified FAE latent space, STARFlow2 supports cache-friendly interleaved generation where both text and visual outputs directly enter the KV-cache without re-encoding. Experiments demonstrate strong performance across image generation and multimodal understanding benchmarks, validating autoregressive flows as a viable foundation for unified multimodal modeling.

  • † UIUC
  • ** Work done while at Apple
── more in #artificial-intelligence 4 stories · sorted by recency
── more on @uiuc 3 stories trending now
sponsored brought to you by zahid.host 4,200+ EU-deployed projects
reading about agents? ship yours in a single git push.

Run your AI side-project on zahid.host

EU-based hosting, git-push deploys, automatic HTTPS, no cold starts. Free tier with a custom domain — perfect for shipping the agent you just read about.

$git push zahid main
Live at https://your-agent.zahid.host
Get free account → Pricing
from €0/mo · no card required
LIVE [news/starflow2-bridging-l…] indexed:0 read:1min 2026-08-25 ·