cd /news/artificial-intelligence/nvidia-s-opt-in-mxfp8-kernel-hits-2-… · home › topics › artificial-intelligence › article
[ARTICLE · art-171142] src=runtimewire.com ↗ pub= topic=artificial-intelligence verified=true sentiment=↑ positive

NVIDIA's opt-in MXFP8 kernel hits 2.5x in a Kimi K3 microbenchmark on one VR200

NVIDIA merged an opt-in TensorRT-LLM path on November 16 that runs eligible Kimi K3 shared experts with packed MXFP8 weights on SM107 hardware, with contributor-reported gains reaching 2.5x in an eager prefill microbenchmark on one VR200 GPU. The merged pull request benchmarks a single shared-expert layer, and NVIDIA says end-to-end latency and accuracy were not measured; the 2.5x figure is the best eager prefill result, at 8,192 tokens.

read1 min views3 publishedNov 17, 2026
NVIDIA's opt-in MXFP8 kernel hits 2.5x in a Kimi K3 microbenchmark on one VR200
Image: Runtimewire (auto-discovered)

The TensorRT-LLM change is off by default and targets replicated shared experts on SM107.

        By [RuntimeWire Staff](https://runtimewire.com/author/runtimewire-staff)
        · Published 

NVIDIA merged an opt-in TensorRT-LLM path on November 16th that runs eligible Kimi K3 shared experts with packed MXFP8 weights on SM107 hardware, with contributor-reported gains reaching 2.5x in an eager prefill microbenchmark on one VR200 GPU.

The merged pull request benchmarks a single shared-expert layer. NVIDIA says end-to-end latency and accuracy were not measured. The 2.5x figure is the best eager prefill result, at 8,192 tokens.

What the kernel changes…

── more in #artificial-intelligence 4 stories · sorted by recency
── more on @nvidia 3 stories trending now
sponsored brought to you by zahid.host 4,200+ EU-deployed projects
reading about agents? ship yours in a single git push.

Run your AI side-project on zahid.host

EU-based hosting, git-push deploys, automatic HTTPS, no cold starts. Free tier with a custom domain — perfect for shipping the agent you just read about.

$git push zahid main
→ Live at https://your-agent.zahid.host ✓
Get free account → Pricing
from €0/mo · no card required
LIVE [news/nvidia-s-opt-in-mxfp…] indexed:0 read:1min 2026-11-17 · —