PipeNetwork/minimax-h3-mlx

Simon Willison successfully ran MiniMax-H3, a text-to-video model, on an Apple M5 Max MacBook Pro using the PipeNetwork/minimax-h3-mlx Python package, which ports the model to MLX. The process downloaded approximately 115 GB of model files and generated a video for the prompt 'a rainbow colored skunk leaps over a mossy log in a supermarket' in just under 45 minutes, though the audio was poor due to lack of prompt guidance.

This Python package ports it to MLX for running on Apple Silicon. I got it running on my M5 Max MacBook Pro. I cloned the repo and ran the model like this: First download the models uvx --from huggingface hub hf download MiniMaxAI/MiniMax-H3 \ --include 'FL2VA/ ' --exclude 'FL2VA/transformer/ ' uvx --from huggingface hub hf download pipenetwork/MiniMax-H3-MLX-8bit Now run the prompt uv run --with mlx-vlm \ --with-requirements requirements.txt python scripts/generate.py \ "a rainbow colored skunk leaps over a mossy log in a supermarket" \ -o skunk.mp4 \ -c ~/.cache/huggingface/hub/models--MiniMaxAI--MiniMax-H3/snapshots/fa9c8ab1eaa21c8ae25e7e40b83b2e6002f340af/FL2VA \ -t ~/.cache/huggingface/hub/models--pipenetwork--MiniMax-H3-MLX-8bit/snapshots/3ac52081470b0488921c3ec3ba84a39097bf2361 Here's the video I got for the prompt: a rainbow colored skunk leaps over a mossy log in a supermarket It downloaded ~115 GB of model files, and the video generation took just under 45 minutes. The video is impressive, but the audio is weird speech-like garbage, because I didn't provide any prompt guidance as to what the audio should be. The prompting guide https://huggingface.co/MiniMaxAI/MiniMax-H3/blob/main/docs/VIDEO PROMPT WRITING GUIDE base en.md which I didn't read prior to this experiment has a whole bunch of information on how to get this to work. Tags: ai https://simonwillison.net/tags/ai , generative-ai https://simonwillison.net/tags/generative-ai , mlx https://simonwillison.net/tags/mlx , text-to-video https://simonwillison.net/tags/text-to-video , minimax https://simonwillison.net/tags/minimax