{"slug": "nvidia-nemotron-3-5-120b-open-agent-model-4gb-bolt-ships-oct-23", "title": "NVIDIA Nemotron 3.5: 120B Open Agent Model — 4GB Bolt Ships Oct 23", "summary": "NVIDIA released three open Nemotron 3.5 models on October 15, with the Nemotron 3.5 Super VL (120B total / 12B active) and Nemotron 3.5 Bolt 74B-A9B (24GB) available now on Hugging Face and NVIDIA Build, and the 4GB edge model Nemotron 3.5 Bolt E4B shipping October 23. NVIDIA reports Super VL, fine-tuned with GRPO reinforcement learning via NeMo RL, improves 9–44% over Claude Opus 5 and GPT-6.1 Sol on five domain benchmarks, and both Super VL and Bolt ship under the OpenMDW License Agreement v1.1 rather than an Apache 2.0 weights license. The Unsloth GGUF quantization of Bolt 74B reports 84 tok/s on RTX Spark hardware, targeting local agent workloads on GeForce RTX, Jetson, and DGX Spark.", "body_md": "NVIDIA released three open Nemotron 3.5 models on October 15. Two are live now. The third — a 4GB edge model called Bolt E4B — arrives October 23. If you have been waiting for a local AI agent that fits in the same VRAM budget as a game, that is your date.\n\n## Three Models, Three Use Cases\n\nThe Nemotron 3.5 lineup covers data center to desktop edge:\n\n- **Nemotron 3.5 Super VL (120B / 12B active)** — Server and enterprise agents. Hybrid Mamba-Transformer mixture-of-experts architecture, 1M token context, accepts text, images, video, audio, and documents in a single pass. Available now on Hugging Face and NVIDIA Build.\n- **Nemotron 3.5 Bolt 74B-A9B (24GB)** — Workstation and laptop. Compressed to 24GB, runs on RTX Spark, DGX Spark, A100, and H100. GGUF and BF16 weights are already on Hugging Face. Available now.\n- **Nemotron 3.5 Bolt E4B (4GB)** — Edge. GeForce RTX, NVIDIA Jetson, DGX Spark. Built for voice assistants, interactive characters, and embedded agents with multi-turn tool use. Ships October 23.\n\nThe 4GB framing is what makes this launch interesting. NVIDIA is targeting physical AI on Jetson — the kind of always-on agent that runs alongside a robotics stack — alongside consumer GPU deployments. The comparison class for E4B is Phi-4 Mini and Gemma 3 4B. It is not a frontier model; expect tradeoffs in reasoning depth. But multi-turn tool use at 4GB is genuinely new territory.\n\n## Running Bolt 74B Right Now\n\nThe 74B Bolt is available today and works with the usual local inference stack. The simplest paths:\n\n```\n# llama.cpp\nbrew install llama.cpp\nllama serve -hf unsloth/NVIDIA-Nemotron-3.5-Bolt-74B-A9B-GGUF:IQ2_XXS\n\n# Ollama\nollama pull nvidia/nemotron-3.5-bolt-74b\nollama run nvidia/nemotron-3.5-bolt-74b\n```\n\nvLLM works on Ampere, Hopper, and Blackwell. LM Studio and Unsloth both have support. The Unsloth GGUF quantization reports 84 tok/s on RTX Spark hardware — fast enough to serve as an interactive agent backend.\n\n## What Super VL Is Actually Built For\n\nSuper VL’s post-training story is where NVIDIA went beyond base capabilities. The model was fine-tuned on specialized enterprise tasks using GRPO reinforcement learning via NeMo RL, and NVIDIA reports 9–44% improvement over Claude Opus 5 and GPT-6.1 Sol on five domain benchmarks: document intelligence, security resilience, financial receipt extraction, scientific experimentation, and medical insurance claims.\n\nThe practical capabilities: tool calling with `auto`, `required`, or `named` function selection; structured JSON output via schema; and a reasoning mode. Atlassian, CrowdStrike, Perplexity, Salesforce, and Synopsys are named early integration partners. NVIDIA’s developer blog has a [full walkthrough of multimodal agentic use cases](https://developer.nvidia.com/blog/nvidia-nemotron-3-5-super-vl-powers-specialized-agents-with-multimodal-reasoning/), including document extraction with schema-constrained JSON output.\n\n## Read the License Before You Ship\n\nThe marketing says “open” and the training infrastructure — NeMo RL and NeMo Gym — is Apache 2.0. The model weights are not. Both Super VL and Bolt are released under the **OpenMDW License Agreement v1.1**. Check whether your use case — commercial deployment, fine-tuning, redistribution — is covered before it becomes a conversation with your legal team after launch. The license is on [Hugging Face alongside the Bolt 74B weights](https://huggingface.co/nvidia/NVIDIA-Nemotron-3.5-Bolt-74B-A9B-BF16). Training recipes and usage cookbooks are in the [NVIDIA-NeMo/Nemotron GitHub repository](https://github.com/NVIDIA-NeMo/Nemotron).\n\n## Mark October 23\n\nSuper VL is the model enterprises will evaluate. Bolt 74B is the model developers will run locally this week. Bolt E4B is the model to watch — it is the first serious attempt at a fully agentic model in a 4GB footprint, and the Jetson target signals NVIDIA’s intent to own the physical AI edge stack from model to hardware. A week from now you will be able to test that claim on any modern GeForce GPU. Details are in [VentureBeat’s benchmark breakdown](https://venturebeat.com/technology/nvidias-new-open-nemotron-3-5-super-vl-with-post-training-beats-claude-opus-5-gpt-6-1-sol-on-specialized-task-benchmarks) and on the [official NVIDIA Nemotron 3.5 blog post](https://blogs.nvidia.com/blog/nemotron-3-5-super-vl/).", "url": "https://wpnews.pro/news/nvidia-nemotron-3-5-120b-open-agent-model-4gb-bolt-ships-oct-23", "canonical_source": "https://byteiota.com/nvidia-nemotron-35-super-vl-bolt/", "published_at": "2026-10-16 17:07:35+00:00", "updated_at": "2026-10-16 17:23:44.648117+00:00", "lang": "en", "topics": ["large-language-models", "ai-agents", "ai-products", "ai-infrastructure", "ai-tools"], "entities": ["NVIDIA", "Nemotron 3.5 Super VL", "Nemotron 3.5 Bolt 74B-A9B", "Nemotron 3.5 Bolt E4B", "Hugging Face", "NVIDIA Jetson", "Unsloth", "OpenMDW License Agreement v1.1"], "also_reported_by": [], "alternates": {"html": "https://wpnews.pro/news/nvidia-nemotron-3-5-120b-open-agent-model-4gb-bolt-ships-oct-23", "markdown": "https://wpnews.pro/news/nvidia-nemotron-3-5-120b-open-agent-model-4gb-bolt-ships-oct-23.md", "text": "https://wpnews.pro/news/nvidia-nemotron-3-5-120b-open-agent-model-4gb-bolt-ships-oct-23.txt", "jsonld": "https://wpnews.pro/news/nvidia-nemotron-3-5-120b-open-agent-model-4gb-bolt-ships-oct-23.jsonld"}}