We’re happy to announce the release of zml/llmd 20260929.0, which notably brings
deepseek-ai/DeepSeek-V4.1-Flash support on NVIDIA and AMD GPUs. This release adds 2 model families:
As stated, DeepSeek is only available on platforms with enough VRAM to host it natively. We do not plan to support custom quants in the near future.
Obviously the highlight, this is our first release supporting a frontier model. ZML is now mature enough to support complex frontier models, and we wanted to bring it to you. Bear in mind this is a 763B model, weighing 510GB, so for now we only support it on platforms LLMD supports with enough VRAM, namely NVIDIA and AMD GPUs.
source & further reading
zml.ai — original article
Promising inference software, written in Zig