# How to speed up inference on DGX Spark?

> Source: <https://forum.level1techs.com/t/how-to-speed-up-inference-on-dgx-spark/259911#post_3>
> Published: 2026-11-03 03:58:33+00:00

I have tried llama.cpp and vllm but so far only getting 4-6 output tokens/seconds with granite-4.2-30b-fp8

Are there any known tips to get faster output? different models, options, bespoke patches?

 
1 Like

 
[lambda](https://forum.level1techs.com/u/lambda)
2
 
Pick a different model? Ideally MoE.

Check out Qwen 3.8 Flash Next -

 
2 Likes

 
Thank you, I was able to get 40 tokens/seconds with this
