cd /news/large-language-models/nemotron-3-5-bolt-74b-a9b-24gb-a-hyb… · home › topics › large-language-models › article
[ARTICLE · art-158429] src=arxiv.org ↗ pub= topic=large-language-models verified=true sentiment=↑ positive

Nemotron 3.5 Bolt 74B-A9B 24GB: A Hybrid Vision-Language Model for Local AI

NVIDIA researchers released Nemotron 3.5 Bolt 74B-A9B 24GB, a hybrid Mamba-Transformer vision-language model derived from the Nemotron 3.5 Super VL 120B-A12B family, built for memory-constrained local agentic workloads. The model combines Star Elastic compression with 2-bit Quantization-Aware Distillation and ships with a LiLiCorr speculative drafter to hit target inference speed, reaching 84 tokens per second on RTX Spark. The team reports higher accuracy than leading models with similar memory footprints and speed on benchmarks including GDPVal v2, BrowseComp, and Terminal-Bench 2.1.

by read1 min views1 publishedOct 27, 2026

arXiv:2610.33039v1 Announce Type: new Abstract: We introduce Nemotron 3.5 Bolt 74B-A9B 24GB, a hybrid Mamba-Transformer vision-language model that optimizes speed and intelligence per GB of memory used for local agentic workloads. Derived from the Nemotron 3.5 Super VL 120B-A12B model family, Nemotron 3.5 Bolt 74B-A9B 24GB combines Star Elastic compression with 2-bit Quantization-Aware Distillation for memory-constrained deployment. The model is optimized for reasoning, agentic tool use, and web & terminal interactions. We also trained a LiLiCorr speculative drafter that is released alongside the model to reach our target inference speed. The resulting model achieves a higher accuracy than leading models with similar memory footprints and speed across many benchmarks for general agentic capabilities (e.g., GDPVal v2), web browsing (e.g., BrowseComp), and terminal use (e.g., Terminal-Bench 2.1), with a relatively high TPS of 84 on RTX Spark that is comparable to models with much lower active parameter counts and more than sufficient for long-horizon agentic applications.

── more in #large-language-models 4 stories · sorted by recency
── more on @nvidia 3 stories trending now
sponsored brought to you by zahid.host 4,200+ EU-deployed projects
reading about agents? ship yours in a single git push.

Run your AI side-project on zahid.host

EU-based hosting, git-push deploys, automatic HTTPS, no cold starts. Free tier with a custom domain — perfect for shipping the agent you just read about.

$git push zahid main
→ Live at https://your-agent.zahid.host ✓
Get free account → Pricing
from €0/mo · no card required
LIVE [news/nemotron-3-5-bolt-74…] indexed:0 read:1min 2026-10-27 · —