{"slug": "fasth3-preview-v0-1-four-open-weight-h3-models-in-four-steps", "title": "FastH3 Preview v0.1: Four Open-Weight H3 Models in Four Steps", "summary": "FastVideo released four open-weight FastH3 Preview v0.1 checkpoints that reduce MiniMax H3 from 49 transformer calls to four, generating 768p video with 32 kHz stereo audio, while noting that fast motion and fine audio remain weaker than Base H3 and that first/last-frame and reference workflows are not yet supported. The release includes weights, training and inference code, configs, synthetic data, and evaluation artifacts under the MiniMax H3 Community License, aiming for community reproduction and improvement.", "body_md": "**TL;DR.** FastVideo is releasing four text-to-video-and-audio FastH3 Preview\nv0.1 checkpoints. They reduce MiniMax H3 from 49 transformer calls to four and\ngenerate 768p video with 32 kHz stereo audio. The variants explore prompt-only\nand synthetic-video training, and sparse and dense attention. In our qualitative\nchecks, fast motion and fine audio remain weaker than Base H3; first/last-frame\nand reference workflows are not supported yet.\n\nThis is an open release: weights, FastVideo training and inference code, exact configs, synthetic Base-H3 data, evaluation artifacts, and the sampling contract. We want the community to reproduce the recipe and improve it with us.\n\n## Why open H3 matters[#](#why-open-h3-matters)\n\nThe strongest video systems were mostly closed until MiniMax released the\n[H3-Base weights](https://huggingface.co/MiniMaxAI/MiniMax-H3). With downloadable\nweights, the community can inspect H3, post-train it, replace kernels, and run it\non its own hardware.\n\nThat ecosystem is already growing. On August 26, fal announced\n[H3 Max](https://fal.ai/learn/devs/introducing-h3-max-by-fal), a hosted\npost-trained H3 model. fal reports stronger quality and a latency below three\nseconds for a five-second 768p request. We have not independently measured those\nclaims, and fal has not announced downloadable H3 Max weights or training code.\nFastH3 takes a complementary path by making the acceleration recipe a shared\nFastVideo asset, not only an endpoint.\n\nThis continues our work on\n[FastWan sparse distillation](/blogs/fastvideo_post_training/) and\n[FastWan-QAD](/blogs/fastwan-qad/). Both releases paired checkpoints with their\nFastVideo training and inference stacks. FastH3 brings the same open development\nmodel to H3.\n\nFastVideo code uses Apache 2.0. H3 and FastH3 weights use the custom\n[MiniMax H3 Community License](https://huggingface.co/MiniMaxAI/MiniMax-H3/blob/main/LICENSE),\nnot a standard open-source model license. Please read it before using or\nredistributing the weights.\n\n## Four preview checkpoints[#](#four-preview-checkpoints)\n\nFastH3 distills H3’s base transformer for text-to-video-and-audio (T2VA) and reuses the H3-Base text encoder, video VAE, audio VAE, tokenizers, and schedulers. All four checkpoints belong to Preview v0.1; their labels describe the recipe, not a version order.\n\nAlongside the weights, FastVideo is releasing:\n\n- DMD2, backward-simulation, VSA, and dense training code with exact configs.\n- Prompts and synthetic Base-H3 videos, with manifests and provenance.\n- Inference scripts, evaluation prompts, timing logs, votes, and negative ablations.\n\nAnother team should be able to reproduce the recipe and train the next checkpoint without private code or data.\n\n| Variant | Training source | Attention | Training step |\n|---|---|---|---|\n|\n\n[VSA / Synthetic / Step 1300](https://huggingface.co/FastVideo/FastVideo-FastH3-4-step-v1.1)[VSA / Synthetic / Step 1900](https://huggingface.co/FastVideo/FastVideo-FastH3-4-step-v1.2)[Dense / Data-Free](https://huggingface.co/FastVideo/FastVideo-FastH3-Dense-4-step-v1)“Data-free” means training uses prompts but no target videos. The synthetic variants use videos generated by Base H3, not camera footage, and come from one run at two steps. The dense variant provides a full-attention comparison. These runs use different training lineages, so their quality differences are useful signals, not controlled ablations. The 8-step and low-noise runs are separate experiments.\n\nAll four checkpoints support T2VA only. H3 uses the base transformer for both T2VA and first/last-frame-to-video-and-audio (FL2VA), but these students were not trained with first/last-frame conditioning. Reference-to-video-and-audio (Ref2VA) uses a separate reference transformer and needs its own distilled checkpoint.\n\n## Performance[#](#performance)\n\nWe will fill this table with results from the exact public checkpoints. Each local test uses FastVideo’s default optimized path and H3’s nominal five-second shape: 124 frames at 24 fps (about 5.17 seconds), 1344x768, stereo audio, and guidance 1.0. We report the median of three timed requests after one full warmup. Model loading and compilation are excluded. End-to-end time includes encoding, denoising, decoding, audio, muxing, and file output; denoise time measures only the DiT loop.\n\n| Model / variant | DiT forwards | Attention | 1× B200 E2E | 4× B200 E2E | 4× B200 denoise | Hosted E2E | Peak GiB / GPU |\n|---|---|---|---|---|---|---|---|\n| Base H3, FastVideo | 49 | Dense FA4 | TBD | TBD | TBD | N/A | TBD |\n| Preview v0.1 VSA family | 4 | VSA, 90% sparse, tile 64 | TBD | TBD | TBD | N/A | TBD |\n| Preview v0.1 Dense / Data-Free | 4 | Dense FA4 | TBD | TBD | TBD | N/A | TBD |\n| H3 Max, fal API | Not disclosed | Not disclosed | N/A | N/A | N/A | Under 3 s, fal-reported; observed TBD | Not disclosed |\n\nThe three VSA checkpoints share one latency row because their tensor shapes, four-step schedule, sparse layout, and FastVideo inference graph are identical. On B200, the default path uses FastVideo’s tile-64 CUDA VSA kernel, regional DiT compilation, H3 fusions, and compiled parallel video VAE. We will evaluate the three checkpoints’ quality separately. H3 Max is a hosted service on undisclosed hardware, so fal’s number is not an apples-to-apples local result.\n\n## How FastH3 works[#](#how-fasth3-works)\n\nBase H3 calls its 33B audio-video diffusion transformer 49 times. FastH3 lowers that cost in two ways: four calls instead of 49, and less attention work inside each call.\n\n**DMD2 cuts the number of calls.**\n[DMD2](https://arxiv.org/abs/2405.14867) trains a student against a frozen Base\nH3 teacher and a learned critic. The student learns from the gap between their\nscores. For prompt-only runs, backward simulation exposes the student to the\nfew-step states it will see at inference. The synthetic-video runs instead start\nfrom forward-noised Base-H3 video-and-audio latents.\n\n**VSA makes each call cheaper.** The\n[VSA paper](https://arxiv.org/abs/2505.13389) introduces trainable sparse\nattention for video diffusion. In FastH3, the student keeps about 10% of eligible\nvideo-to-video tiles (90% sparsity) with 64-token blocks. Text and audio remain\ndense. The teacher and critic also remain dense, giving the sparse student a\nfull-attention target. This extends the\n[FastVideo sparse-distillation recipe](/blogs/fastvideo_post_training/) to H3.\n\n**Reference conditioning needs a new policy.** Keeping a full reference video\ndense would erase most of VSA’s benefit. Our reference-aware policy treats each\nreference video and the output video as a separate sparse region, while text,\nimages, and audio stay dense. This work uses H3’s separate reference transformer\nand is not part of Preview v0.1.\n\n## Where four steps still fall short[#](#where-four-steps-still-fall-short)\n\n### Fast motion and the noise schedule[#](#fast-motion-and-the-noise-schedule)\n\nIn our qualitative checks, FastH3 is strongest on slower scenes and simple motion. In faster scenes, hair, water, grass, small objects, and sharp moving edges can become soft or smeared.\n\nThe four-step ladder looks evenly spaced: `[999, 749, 500, 250]`\n\n. But H3 maps\neach base timestep through a shift of 12 for video and 3 for audio. The effective\nnoise levels are:\n\n| Experiment | Base timesteps | Effective video noise | Effective audio noise |\n|---|---|---|---|\n| Current 4-step | `[999, 749, 500, 250]` | `[1.000, 0.973, 0.923, 0.800]` | `[1.000, 0.900, 0.750, 0.500]` |\n| 8-step experiment | `[999, 874, 749, 624, 500, 375, 250, 125]` | `[1.000, 0.988, 0.973, 0.952, 0.923, 0.878, 0.800, 0.632]` | `[1.000, 0.954, 0.900, 0.833, 0.750, 0.643, 0.500, 0.300]` |\n| 4-step low-noise experiment | `[999, 600, 250, 50]` | `[1.000, 0.947, 0.800, 0.387]` | `[1.000, 0.818, 0.500, 0.136]` |\n\nThe current model’s last call happens while video noise is still 0.80. One large final update must recover fine detail and fast motion at once. That matches the blur and smearing we see, but it is still a hypothesis.\n\nThe 8-step run adds more calls. The low-noise run keeps four calls but moves the last one closer to the clean output, from video noise 0.80 to 0.387. FastVideo uses the same schedule for training and validation because changing only the inference schedule can hurt a distilled model. More low-noise work may sharpen edges but weaken composition or large motion, so we will compare both runs before choosing a new default.\n\n### Aligning audio and video[#](#aligning-audio-and-video)\n\nWe fixed two sources of mismatch. First, FastVideo now derives every video and audio noise level from one shared base timestep, then applies H3’s video shift of 12 and audio shift of 3. Training, validation, and inference stay on the same paired schedule.\n\nSecond, H3 packs audio on a 40 Hz clock tied to the video length, while the audio VAE can round up by one latent. FastVideo now trims or edge-pads the audio latent to the exact packed length. These are latent and diffusion-clock fixes, not a late MP4 offset. Fine audio detail can still be weak, so evaluation will include listening tests and an audio-video sync metric.\n\n## Try FastH3[#](#try-fasth3)\n\nThe optimized FastVideo path targets NVIDIA B200 GPUs with CUDA 13. Startup loads the model, and the first generation compiles it. Use a warm request for steady-state timing.\n\n```\ngit clone https://github.com/hao-ai-lab/FastVideo.git\ncd FastVideo\ngit checkout FASTVIDEO_RELEASE_COMMIT\nuv venv --python 3.12 --seed\nsource .venv/bin/activate\nUV_TORCH_BACKEND=cu130 uv pip install -e \".[fasth3]\"\nPROMPT='integrated_multimodal_description: A red fox runs through fresh snow at dawn. overall_soundscape: Fast pawsteps in snow, winter wind, and distant birds.'\nMODEL_PATH='FastVideo/FastVideo-FastH3-4-step-v1.2'\nexport FASTVIDEO_DMD_DENOISING_STEPS=999,749,500,250\n\npython examples/inference/basic/basic_fasth3.py \\\n  --model-path \"$MODEL_PATH\" \\\n  --prompt \"$PROMPT\" \\\n  --output outputs/fasth3_fox \\\n  --num-gpus 4 \\\n  --repeats 1\n```\n\nThe example uses five scheduler points, which produce exactly four DiT calls. Keep the trained schedule, 90% VSA sparsity, tile size 64, and guidance 1.0; changing them can hurt quality. This command uses VSA / Synthetic / Step 1900. The other VSA checkpoints use the same command with a different model path. See the Dense / Data-Free model card for its command.\n\n## What comes next[#](#what-comes-next)\n\nPreview v0.1 is an early checkpoint family, not a claim that four steps have solved H3. FastVideo’s next priorities are:\n\n### 1. Publish a quality result people can audit[#](#1-publish-a-quality-result-people-can-audit)\n\nWe will compare every checkpoint with Base H3 and H3 Max on 60 held-out prompts. The study will match the 768p output tier, aspect ratio, and audio settings as closely as each system allows; record the actual frame count and duration; randomize left and right; and collect at least three votes per pair. We will publish checkpoint hashes, prompts, seeds, every vote, prompt-level confidence intervals, and representative wins, ties, and losses with audible clips.\n\nFor the direct H3 Max comparison, we will set its\n[ prompt_expansion_mode](https://fal.ai/models/minimax/h3-max/text-to-video/api)\nto\n\n`disabled`\n\n, use its seed control, and time the full client request. We will\nreport the hosted default with prompt expansion as a separate product\ncomparison. FastH3 clips will use FastVideo’s default optimized path. Preference\nis `(wins + ties / 2) / votes`\n\n; confidence intervals will be computed over\nprompts rather than treating repeated votes as independent samples.| FastH3 candidate | Opponent | FastH3 W / T / L | Preference (95% CI) | Prompts | Votes / pair |\n|---|---|---|---|---|---|\n| VSA / Data-Free | Base H3 | TBD | TBD | 60 | TBD |\n| VSA / Data-Free | H3 Max | TBD | TBD | 60 | TBD |\n| VSA / Synthetic / Step 1300 | Base H3 | TBD | TBD | 60 | TBD |\n| VSA / Synthetic / Step 1300 | H3 Max | TBD | TBD | 60 | TBD |\n| VSA / Synthetic / Step 1900 | Base H3 | TBD | TBD | 60 | TBD |\n| VSA / Synthetic / Step 1900 | H3 Max | TBD | TBD | 60 | TBD |\n| Dense / Data-Free | Base H3 | TBD | TBD | 60 | TBD |\n| Dense / Data-Free | H3 Max | TBD | TBD | 60 | TBD |\n\nWe will publish losses and ties, not only wins. Reviewers will see the full clip and hear its audio. Four padding duplicates from distributed validation are excluded.\n\n### 2. Improve motion and offer an eight-step option[#](#2-improve-motion-and-offer-an-eight-step-option)\n\nWe will finish the four-step low-noise A/B and the 8-step control. We will then test stronger final-step training, more low-noise critic samples, motion-sensitive losses, and learned timestep placement. The four-step model targets minimum latency; eight steps may be a better quality setting. We will release an 8-step checkpoint only after a matched comparison.\n\n### 3. Add FL2VA and Ref2VA[#](#3-add-fl2va-and-ref2va)\n\nT2VA is only one H3 workflow. FL2VA uses the base transformer but needs new conditioning training. Ref2VA uses the separate reference transformer, so FastVideo must distill it separately. We will evaluate mixed reference types, long clips, and reference fidelity before releasing either workflow.\n\n### 4. Evaluate audio quality[#](#4-evaluate-audio-quality)\n\nA decodable 32 kHz stereo track is only the first gate. We will measure speech, effects, ambience, music, timing, and audio-video sync, and add human listening tests. The paired-schedule and packed-length checks will remain regression tests.\n\n### 5. Make H3 easier to run and extend[#](#5-make-h3-easier-to-run-and-extend)\n\nAt four calls, encoding, VAE decode, audio, and file output become a larger share of latency. FastVideo will keep improving VAE compilation and parallelism, sparse compilation, portable kernels, cold start, and multi-GPU serving. We will also study FP8 and NVFP4 with visible quality gates. Stable releases will include the checkpoint, config, sampling contract, code revision, data provenance, and negative ablations.\n\n## Help us test more hardware[#](#help-us-test-more-hardware)\n\nOur published numbers use NVIDIA B200 GPUs. We welcome results from other single- and multi-GPU systems that can load FastH3. Run the default example and report the GPU model and count, driver and CUDA versions, FastVideo commit, checkpoint, output shape, warmup, end-to-end and denoising time, peak memory, and a sample clip.\n\nShare results, unsupported hardware, regressions, and new ideas on\n[GitHub](https://github.com/hao-ai-lab/FastVideo) or in the\n[FastVideo Slack](https://join.slack.com/t/fastvideo/shared_invite/zt-3f4lao1uq-u~Ipx6Lt4J27AlD2y~IdLQ).\nExplore the\n[four-checkpoint collection](https://huggingface.co/collections/FastVideo/fastvideo-fasth3-6a8fbe67cc83dad6fa49360b),\nrun the [FastVideo example](https://github.com/hao-ai-lab/FastVideo/blob/main/examples/inference/basic/basic_fasth3.py),\nand show us where FastH3 works—and where it does not.\n\n## Acknowledgements[#](#acknowledgements)\n\nWe thank our collaborators on the [NVIDIA FastGen](https://github.com/NVlabs/FastGen)\nteam. Their reference implementation helped us align DMD2’s score clock,\nmodality shifts, and backward-simulation behavior. We also thank MiniMax for\nreleasing H3-Base, fal for adding another H3 direction to the ecosystem, the\nDMD2 and VSA authors, the FlashAttention and CUTLASS teams, and every FastVideo\ncontributor who built and tested the model, kernels, training path, evaluation\ntools, and serving stack.\n\n## Citations[#](#citations)\n\nMethod background: the [DMD2 paper](https://arxiv.org/abs/2405.14867), the\n[VSA paper](https://arxiv.org/abs/2505.13389), our earlier\n[FastWan sparse-distillation blog](/blogs/fastvideo_post_training/), and the\n[FastWan-QAD blog](/blogs/fastwan-qad/). If you build on FastH3, please cite this\nrelease, DMD2, VSA, and FastVideo.\n\n```\n@misc{fastvideo_fasth3_2026,\n  title        = {FastH3 Preview v0.1: Four Open-Weight H3 Models in Four Steps},\n  author       = {FastVideo Team},\n  year         = {2026},\n  howpublished = {\\url{https://haoailab.com/blogs/fasth3-preview/}},\n}\n\n@misc{yin2024improved,\n  title         = {Improved Distribution Matching Distillation for Fast Image Synthesis},\n  author        = {Tianwei Yin and Michaël Gharbi and Taesung Park and Richard Zhang and Eli Shechtman and Fredo Durand and William T. Freeman},\n  year          = {2024},\n  eprint        = {2405.14867},\n  archivePrefix = {arXiv},\n  primaryClass  = {cs.CV},\n}\n\n@article{zhang2025vsa,\n  title   = {VSA: Faster Video Diffusion with Trainable Sparse Attention},\n  author  = {Peiyuan Zhang and Yongqi Chen and Haofeng Huang and Will Lin and Zhengzhong Liu and Ion Stoica and Eric Xing and Hao Zhang},\n  journal = {arXiv preprint arXiv:2505.13389},\n  year    = {2025},\n}\n\n@software{fastvideo2024,\n  title  = {FastVideo: A Unified Framework for Accelerated Video Generation},\n  author = {The FastVideo Team},\n  url    = {https://github.com/hao-ai-lab/FastVideo},\n  year   = {2024},\n}\n```\n\n", "url": "https://wpnews.pro/news/fasth3-preview-v0-1-four-open-weight-h3-models-in-four-steps", "canonical_source": "https://haoailab.com/blogs/fasth3-preview/", "published_at": "2026-08-27 07:00:00+00:00", "updated_at": "2026-08-27 10:49:41.930155+00:00", "lang": "en", "topics": ["artificial-intelligence", "generative-ai", "ai-research", "ai-products", "ai-infrastructure"], "entities": ["FastVideo", "MiniMax H3", "H3-Base", "fal", "H3 Max", "FastWan"], "alternates": {"html": "https://wpnews.pro/news/fasth3-preview-v0-1-four-open-weight-h3-models-in-four-steps", "markdown": "https://wpnews.pro/news/fasth3-preview-v0-1-four-open-weight-h3-models-in-four-steps.md", "text": "https://wpnews.pro/news/fasth3-preview-v0-1-four-open-weight-h3-models-in-four-steps.txt", "jsonld": "https://wpnews.pro/news/fasth3-preview-v0-1-four-open-weight-h3-models-in-four-steps.jsonld"}}