{"slug": "minimax-s-new-inference-stack-renders-5-seconds-of-video-with-stereo-audio-in-2", "title": "MiniMax's new inference stack renders 5 seconds of video with stereo audio in under 2 seconds, about 11 times faster than its own base model", "summary": "NVIDIA Research and Singapore Lab introduced Sol-H3, an inference stack for MiniMax's H3 video generation model, that renders 5 seconds of video with stereo audio in 1.653 seconds on an 8× NVIDIA B300 system—11.04 times faster than the base model's 18.250 seconds. The stack combines Sol-Engine and Sol-Attn to unify sparse attention, fused kernels, and multi-GPU communication, achieving up to 15.05× speedup for 15-second outputs.", "body_md": "Sol-H3Speed-of-Light MiniMax-H3 on an 8× NVIDIA B300 Blackwell System\n\nNVIDIA Research, Efficient AI Team & Singapore Lab.\n\n5sof world.1.653sto infer.\n\nSol-H3 generates MiniMax-H3 video with native audio faster than playback on one 8× NVIDIA B300 system.\nSol-Engine × Sol-Attn unifies sparse attention, fused kernels, fast multi-GPU communication, parallel video decoding, and other serving optimizations in one runtime.\n\nFeatured sample · MiniMax-H3 Base Ref2VA at 50 steps, generated through Sol-Engine on 8× NVIDIA B300.\n\nScroll to enter the engine\n\n01\n\nBenchmark · 8 / 4 / 1× NVIDIA B300\n\nLatency across GPU counts.\n\nChoose an output length, then compare Sol-H3 directly with Base H3 across 8, 4, and 1 B300 GPUs.\n\nMeasured generation time · seconds\n\nGeneration time across GPU counts.\n\nMeasured latency for 50-step Base H3 Dense and four-step Sol-H3 at 5, 10, and 15 second output lengths on one, four, and eight NVIDIA B300 GPUs.\n\nGPU count\n\n5s124 frames · 1344×768 · 24 FPS · stereo audio\n\n10s243 frames · 1344×768 · 24 FPS · stereo audio\n\n15s362 frames · 1344×768 · 24 FPS · stereo audio\n\n8×NVIDIA B300\n\nBase H3Dense · 50 steps18.250 s\n\nSol-H3Ours · 4 steps1.653 s11.04× faster\n\nBase H3Dense · 50 steps50.660 s\n\nSol-H3Ours · 4 steps3.732 s13.57× faster\n\nBase H3Dense · 50 steps99.513 s\n\nSol-H3Ours · 4 steps6.612 s15.05× faster\n\n4×NVIDIA B300\n\nBase H3Dense · 50 steps35.328 s\n\nSol-H3Ours · 4 steps2.918 s12.11× faster\n\nBase H3Dense · 50 steps100.440 s\n\nSol-H3Ours · 4 steps6.993 s14.36× faster\n\nBase H3Dense · 50 steps194.930 s\n\nSol-H3Ours · 4 steps12.542 s15.54× faster\n\n1×NVIDIA B300\n\nBase H3Dense · 50 steps129.898 s\n\nSol-H3Ours · 4 steps13.745 s9.45× faster\n\nBase H3Dense · 50 steps376.942 s\n\nSol-H3Ours · 4 steps37.813 s9.97× faster\n\nBase H3Dense · 50 steps746.885 s\n\nSol-H3Ours · 4 steps52.260 s14.29× faster\n\nMeasured scopeAll runs use 1344×768, 24 FPS, the same prompt and seed 20260903, and reference-free T2VA with stereo audio. The complete profiles differ: Base H3 uses 50 scheduler points (49 DiT forwards), while Sol-H3 uses four DiT forwards—not an attention-only runtime change. Sol-H3 uses Dense attention on 1× B300 and SOL with INT8 QKV / FP8 output transport on 4× / 8× B300. Each value is the median of three measured runs after one warmup. Timing includes text encoding, DiT denoising, and video/audio VAE decoding; model loading, compilation warmup, and final MP4 encoding are excluded.\n\n02\n\nSelected Sol-H3 generations\n\nSol-H3 video showcase.\n\nBrowse ten-second Sol-H3 videos with native audio, two examples at a time.\n\nLoading showcaseGenerated with Sol-H3\n\nSelected examples.\n\nBrowse two videos at a time with the arrows; each video includes its exact prompt.\n\nShowcase profileEach ten-second sample is generated by Sol-H3 at 1344×768 with native audio, using Sol-H3’s four-step Dense/Data-Free adapter from FastH3 Preview v1.\n\n03\n\nTwo core systems\n\nSol-Engine × Sol-Attn.\n\nSol-Engine speeds up the complete inference pipeline. Sol-Attn selects attention blocks while the model runs, with no retraining.\n\nSol-Engine keeps the model ready and coordinates GPU kernels, communication across eight GPUs, compilation, and video/audio decoding.\n\n02 · Sol-Attn\n\nSelect the blocks that matter.\n\nSol-Attn uses a query-dependent threshold to keep important attention blocks exact and cheaply approximate the rest. It works directly from the model’s Q/K/V tensors, so existing weights need no retraining.\n\n04\n\nSix optimizations · one runtime\n\nHow Sol-H3 gets faster.\n\nEach card pairs one optimization with how it works, why it is faster, and the measured evidence.\n\nEach 64-token query block sets its own threshold: mean + τ × standard deviation over lightweight query–key scores. Selected blocks use exact attention; skipped blocks receive an approximate correction from pooled K/V summaries.\n\nWhy it is faster\n\nRouting, sparse attention, and approximate correction share one online-softmax pass. Sol-Attn writes no separate router output, full score map, or routing-index tensor, and needs no retraining.\n\nGPU kernels\n\nFuse repeated operations\n\nNorm · RoPE · MLP\n\n02GPU kernels\n\nMove less data between operations.\n\nMechanism\n\nSol-H3 fuses three repeated chains: residual + RMSNorm + modulation, QKNorm + partial RoPE, and SwiGLU. Their intermediate tensors stay in registers or on chip instead of returning to GPU memory between operations.\n\nWhy it is faster\n\nThese operations touch wide tensors but do relatively little math, so memory traffic is often the limit. Fewer reads, writes, and launches save traffic across all 50 transformer blocks.\n\nMulti-GPU communication\n\nFaster 8-GPU data exchange\n\nPack · all-to-all · merge\n\n038-GPU exchange\n\nPack, exchange, and merge directly.\n\nMechanism\n\nUlysses redistributes sequence shards by attention head, then restores the original layout. Sol-H3 packs Q/K/V directly for the destination GPU, performs one all-to-all exchange, and merges returned heads without extra full-tensor layout copies.\n\nWhy it is faster\n\nThis removes separate stack, permute, and contiguous copies. The fastest profile sends QKV in INT8 and attention output in FP8; BF16 transport remains available when higher numerical fidelity is preferred.\n\nSparse-attention setup\n\nFuse the setup work\n\nK/V summaries · threshold · metadata\n\nBeforeFused\n\n04Sparse setup\n\nBuild the sparse plan in fewer passes.\n\nMechanism\n\nOne preprocessing kernel computes each key centroid and value sum together. Thresholding also returns the pooled query for reuse; the final compaction step applies threshold, local-band, and exact-prefix rules while emitting the mask and compact block lists.\n\nWhy it is faster\n\nThe default SOL path feeds its fused K/V summaries, mask, and block list directly into cuDNN block-sparse attention. The optional native Sol-Attn kernel combines routing and sparse attention in one pass. Both reduce temporary traffic and launch overhead.\n\nVideo decoding\n\nParallel VAE decoding\n\nTile parallel · batch · compile\n\n05VAE decoding\n\nDecode spatial tiles in parallel.\n\nMechanism\n\nA 5s output has seven temporal clips and 196 equal spatial tiles. The default path distributes the full tile set over eight GPUs, batches each GPU’s share into one compiled decoder call, and gathers once.\n\nWhy it is faster\n\nTile sharding cuts the work per GPU, while global batching replaces seven per-clip decode-and-gather rounds with one. A per-clip path remains available when matching the initial output exactly matters.\n\nConditioning\n\nPrecompute AdaLN\n\nPrecompute · cache · direct lookup\n\n06AdaLN cache\n\nCompute conditioning once, then reuse it.\n\nMechanism\n\nAll AdaLN values are knowable before denoising. Sol-H3 projects every block-and-step value up front, caches the full trajectory, and releases the projection weights before the denoising loop.\n\nWhy it is faster\n\nEach block reads its cached slice directly instead of running two index selections. Across 50 blocks and four steps, that removes about 400 small launches and avoids roughly 26 GB of GPU-memory reads per step without changing output.", "url": "https://wpnews.pro/news/minimax-s-new-inference-stack-renders-5-seconds-of-video-with-stereo-audio-in-2", "canonical_source": "https://nvlabs.github.io/Sana/Sol-Engine/Sol-H3/", "published_at": "2026-09-08 14:41:23+00:00", "updated_at": "2026-09-08 14:58:00.239266+00:00", "lang": "en", "topics": ["artificial-intelligence", "generative-ai", "ai-infrastructure", "ai-research"], "entities": ["NVIDIA Research", "Singapore Lab", "MiniMax", "Sol-H3", "Sol-Engine", "Sol-Attn", "NVIDIA B300"], "alternates": {"html": "https://wpnews.pro/news/minimax-s-new-inference-stack-renders-5-seconds-of-video-with-stereo-audio-in-2", "markdown": "https://wpnews.pro/news/minimax-s-new-inference-stack-renders-5-seconds-of-video-with-stereo-audio-in-2.md", "text": "https://wpnews.pro/news/minimax-s-new-inference-stack-renders-5-seconds-of-video-with-stereo-audio-in-2.txt", "jsonld": "https://wpnews.pro/news/minimax-s-new-inference-stack-renders-5-seconds-of-video-with-stereo-audio-in-2.jsonld"}}