cd /news/ai-infrastructure/nvidia-s-tensorrt-llm-cuts-deepseek-… · home › topics › ai-infrastructure › article
[ARTICLE · art-170632] src=runtimewire.com ↗ pub= topic=ai-infrastructure verified=true sentiment=↑ positive

NVIDIA's TensorRT-LLM cuts DeepSeek V4 tuning time 70% in test

NVIDIA merged pull request 21185 into TensorRT-LLM main on November 16th, 2026, adding an optional nvMatmulHeuristics policy that cut DeepSeek V4 Pro cold autotuning from 226.6 seconds to 68.2 seconds in contributor-reported tests. Across 48 FP8 BMM and MXFP8 GEMM shapes, the heuristic path profiled 838 tactics instead of 82,160 with the full sweep, a roughly 98x reduction, and server start-to-ready time fell from 514 seconds to 350 seconds on two nodes with four VR200 GPUs each. The feature stays off by default.

read1 min views3 publishedNov 16, 2026
NVIDIA's TensorRT-LLM cuts DeepSeek V4 tuning time 70% in test
Image: Runtimewire (auto-discovered)

The merged TensorRT-LLM policy profiled 838 tactics instead of 82,160 on DeepSeek V4 Pro, and the feature stays off by default.

        By [RuntimeWire Staff](https://runtimewire.com/author/runtimewire-staff)
        · Published 

NVIDIA merged pull request 21185 into TensorRT-LLM main on November 16th, 2026, adding an optional nvMatmulHeuristics policy that cut DeepSeek V4 Pro cold autotuning from 226.6 seconds to 68.2 seconds in contributor-reported tests. Across 48 FP8 BMM and MXFP8 GEMM shapes, the heuristic path profiled 838 tactics, down from 82,160 with the full sweep, a reduction of about 98 times. Server start-to-ready time fell from 514 seconds to 350 seconds on two nodes with four VR200 GPUs each.…

── more in #ai-infrastructure 4 stories · sorted by recency
── more on @nvidia 3 stories trending now
sponsored brought to you by zahid.host 4,200+ EU-deployed projects
reading about agents? ship yours in a single git push.

Run your AI side-project on zahid.host

EU-based hosting, git-push deploys, automatic HTTPS, no cold starts. Free tier with a custom domain — perfect for shipping the agent you just read about.

$git push zahid main
→ Live at https://your-agent.zahid.host ✓
Get free account → Pricing
from €0/mo · no card required
LIVE [news/nvidia-s-tensorrt-ll…] indexed:0 read:1min 2026-11-16 · —