Liquid AI Releases LFM2.5-VL-3B-DSpark: Speculative Decoding for Vision-Language Models With Up to 3.13x Faster Decoding

Liquid AI released LFM2.5-VL-3B-DSpark, an experimental speculative-decoding draft model for its LFM2.5-VL-3B vision-language model that adds about 279.5M parameters and delivers up to 3.13x faster decoding on Apple silicon and up to 2.66x on an NVIDIA H100 without changing the model's output. Weights are live on Hugging Face in Safetensors and GGUF with day-one support in SGLang, MLX-VLM, and llama.cpp, under the LFM Open License v1.0, which allows free commercial use only for companies under $10M in annual revenue. The drafter uses a 4-layer attention-only architecture with a block size of 9, raising the deployed parameter count by 8.9%, and was trained for 10 epochs entirely on AMD hardware.

Liquid AI has announced https://x.com/liquidai/status/2103131179100819783 LFM2.5-VL-3B-DSpark https://huggingface.co/LiquidAI/LFM2.5-VL-3B-DSpark , an experimental speculative-decoding draft model for its LFM2.5-VL-3B https://huggingface.co/LiquidAI/LFM2.5-VL-3B vision-language model. The drafter adds about 280M parameters and speeds up decoding without changing the model’s output. Liquid AI team reports https://www.liquid.ai/blog/lfm2-5-vl-dspark up to 3.13x faster decoding on Apple silicon and up to 2.66x on an NVIDIA H100. Is it deployable? Yes, Weights are live on Hugging Face in Safetensors and GGUF https://huggingface.co/LiquidAI/LFM2.5-VL-3B-DSpark-GGUF , with day-one support in SGLang, MLX-VLM, and llama.cpp. Liquid AI team labels the release experimental, and it ships under the LFM Open License v1.0 https://docs.liquid.ai/lfm/help/model-license , which allows free commercial use only for companies under $10M in annual revenue. What Speculative Decoding Changes for a VLM A standard model generates one token per forward pass. Speculative decoding adds a small drafter that proposes several tokens ahead. The large target model then checks the whole block in one pass and keeps the tokens it agrees with. DSpark follows the recipe from Liquid AI’s text-model DSpark drafters https://www.liquid.ai/blog/lfm2.5-dspark , described in the DSpark paper https://arxiv.org/abs/2607.05147 . The drafter reads the target model’s hidden states from several layers and predicts the next k tokens. The key design point: modality does not matter to the drafter. By the time tokens reach the hidden layers, text and image patches are both just tensors. So Liquid AI team reuses the exact same inference algorithm for its vision-language model. Drafter Architecture and Training The drafter is a simplified attention-only model. Ablations picked 4 layers and a block size of 9. Liquid AI recommends a block size of 8 or 9 at inference, depending on hardware. Apple silicon runs use 8. | Component | Parameters | |---|---| | Decoder stack 4 layers | 193.0M | | Hidden-state projection | 21.0M | | Markov head | 65.5M | | Norms + confidence head | 6.4k | | Total | 279.5M | The embedding and LM head are tied to the target, so the drafter does not carry them. Liquid AI says this raises the deployed parameter count by 8.9%. Training used supervised fine-tuning data covering common vision-language tasks for 10 epochs. All ablations and training ran exclusively on AMD hardware. Benchmark Results Evaluation follows the MMSpec benchmark https://arxiv.org/abs/2603.14989 across 6 task types: General VQA, Text VQA, Image Captioning, Chart VQA, Complex Reasoning, and Multi-turn Conversation. All runs used batch size 1, temperature 0, and 16-bit weights for the vision encoder and backbone. Data was collected on Pipette https://pipette.liquid.ai/ , Liquid AI’s public device-benchmarking infrastructure. | Stack | Decode speedup | End-to-end speedup | Accepted tokens per pass | |---|---|---|---| | MLX-VLM, M5 Max MacBook Pro block 8 | 2.30x to 3.13x | 1.56x to 2.62x | 3.24 to 4.34 | | llama.cpp, M3 Ultra block 8 | 1.57x to 2.14x | 1.30x to 1.77x | 3.31 to 4.50 | | SGLang, 1x H100 80GB block 9 | 2.04x to 2.66x | 1.64x to 2.27x | 3.46 to 4.57 | The ‘up to’ decode and end-to-end figures often come from different tasks. On the M5 Max, 3.13x decode is from COCO captioning, while 2.62x end-to-end is from MMMU-Pro. Acceptance landed in a similar range on both Apple stacks. Liquid AI reads this as acceptance depending on the drafter and workload, not the runtime. At higher concurrency, DSpark kept a throughput advantage at every measured level on a single H100 in SGLang. The gap narrows as concurrency rises. Output Quality and Temperature Under greedy decoding, the target verifies every proposed token, so output is identical to the base model. At non-zero temperatures with matched sampling, speculative decoding preserves the target’s output distribution, as proven by Leviathan et al. https://arxiv.org/abs/2211.17192 Temperature does affect speed. Higher temperatures spread probability across more candidate tokens, so drafter and target disagree more often. In Liquid AI’s tests, this lowered acceptance and throughput. Why End-to-End Gains Are Smaller on Edge Speculative decoding only accelerates decoding. Image encoding and prefill run at the same speed. A VLM must encode the image, then process hundreds of visual tokens alongside the prompt. On edge devices with less compute than data center GPUs, prefill takes a larger share of latency. Liquid AI frames this as Amdahl’s law: total speedup is bounded by the part left unaccelerated. This explains cases like TextVQA on the M5 Max, where 2.69x faster decoding yields 1.56x end to end. How to Run It SGLang requires v0.5.19 or newer https://github.com/sgl-project/sglang/releases/tag/v0.5.19 . Launch LiquidAI/LFM2.5-VL-3B with --speculative-algorithm DSPARK and point --speculative-draft-model-path at the drafter. On Apple silicon, MLX-VLM https://github.com/Blaizzy/mlx-vlm v0.7.2 or newer accepts the drafter through --draft-model . DSpark in MLX-VLM currently supports greedy sampling only, so set temperature to 0. For llama.cpp, pair the GGUF drafter with the LFM2.5-VL-3B-GGUF https://huggingface.co/LiquidAI/LFM2.5-VL-3B-GGUF target. Integration work is public in the llama.cpp https://github.com/ggml-org/llama.cpp/pull/29339 , SGLang https://github.com/sgl-project/sglang/pull/40651 , and MLX-VLM https://github.com/Blaizzy/mlx-vlm/pull/2280 pull requests. Acceleration of quantized models is outside the scope of this release. Key Takeaways - A 279.5M drafter adds 8.9% parameters to LFM2.5-VL-3B. - Decoding runs up to 3.13x faster on M5 Max, 2.66x on H100. - Output is identical under greedy decoding; distribution preserved when sampling. - Prefill and vision encoding cap end-to-end gains, especially on edge. - Tested at 16-bit only; quantized acceleration is not covered yet. Check out the Technical Details https://www.liquid.ai/blog/lfm2-5-vl-dspark . All credit goes to the researcher of this project. Also, feel free to follow us on Twitter https://x.com/intent/follow?screen name=marktechpost and don’t forget to join our 150k+ML SubReddit https://www.reddit.com/r/machinelearningnews/ and Subscribe to our Newsletter https://magic.beehiiv.com/v1/f5e63dd4-5653-4f09-83e2-321a8b1ba526?email={{email}} . Wait are you on telegram? now you can join us on telegram as well. https://t.me/machinelearningresearchnews Need to partner with us for promoting your GitHub Repo OR Hugging Face Page OR Product Release OR Webinar etc.? Connect with us https://forms.gle/MJjjVDPS7whH8Ngs6 Asif Razzaq is the CEO of Marktechpost AI Media Inc.. As a visionary entrepreneur and engineer, Asif is committed to harnessing the potential of Artificial Intelligence for social good. His most recent endeavor is the launch of an Artificial Intelligence Media Platform, Marktechpost, which stands out for its in-depth coverage of machine learning and deep learning news that is both technically sound and easily understandable by a wide audience. The platform boasts of over 2 million monthly views, illustrating its popularity among audiences.