{"slug": "nvidia-nemotron-3-5-bolt-e4b-4gb", "title": "Nvidia Nemotron 3.5 Bolt E4B 4GB", "summary": "Nvidia released Nemotron 3.5 Bolt E4B 4GB, an open small language model built on Gemma 4 E4B with Nemotron post-training and designed to run conversational agents in roughly 4GB of memory on GeForce RTX, Jetson, RTX Spark and DGX Spark hardware. Nvidia reports the model delivers about 40% higher average quality than its prior Nemotron 3 Nano 4B on key conversational agent benchmarks and outputs up to about 80% fewer tokens than peers. Bolt E4B adds multi-turn tool use, a conversational mode for speech-ready responses, configurable reasoning, a 64k context window and support for 35 languages, targeting device assistants, interactive characters and embedded industrial agents.", "body_md": "# NVIDIA Nemotron 3.5 Bolt E4B 4GB\n\n **Published:** \n\n#### [Technical Report](https://research.nvidia.com/labs/nemotron/files/NVIDIA-Nemotron-3.5-Bolt-E4B-4GB-Technical-Report.pdf)\n\n# Introducing NVIDIA Nemotron 3.5 Bolt E4B 4GB\n\nToday, we’re excited to release [**Nemotron 3.5 Bolt E4B 4GB**](https://huggingface.co/nvidia/NVIDIA-Nemotron-3.5-Bolt-E4B-4GB) — our latest open small language model optimized for speed and intelligence per GB in conversational agents.\n\nBolt E4B builds on Gemma 4 E4B with Nemotron post-training. It combines natural conversation with multi-turn agentic capabilities to power voice/device assistants, interactive characters and robotic/IoT interfaces running on NVIDIA [GeForce RTX](https://www.nvidia.com/en-us/geforce/rtx/), [Jetson](https://www.nvidia.com/en-us/autonomous-machines/embedded-systems/), [RTX Spark](https://www.nvidia.com/en-us/products/rtx-spark/) and [DGX Spark](https://www.nvidia.com/en-us/products/workstations/dgx-spark/).\n\nBolt E4B offers ~40% higher average quality against our [prior model](https://huggingface.co/blog/nvidia/nemotron-3-nano-4b) on key conversational agent benchmarks and outputs up to ~80% fewer tokens vs peers.\n\nDesigned to pack conversational agent intelligence into as little as ~4GB in its target workloads, Bolt E4B enables responsive local experiences while preserving headroom for applications and other models in the same pipeline.\n\n## Model Features\n\n- **Multi-turn tool use** : call application APIs to carry out tasks across a conversation, with integration guidance for asynchronous tool calls\n- **Conversational mode** : toggle to encourage concise, speech-ready responses for natural back-and-forth interactions\n- **Configurable reasoning** : enable reasoning for complex requests or disable it for faster responses, with integration options to cap thinking to meet latency targets\n- **64k context** : accommodate conversation history, instructions, tool definitions, retrieved information and application state\n- **Multilingual capability** : support for 35 languages, building on a base model pre-trained on +140 languages\n\n## Agents On Every Device\n\nWe’re always learning from how NVIDIA Jetson, GeForce RTX and DGX Spark customers — enterprises and enthusiasts alike — use our hardware to accelerate their workloads.\n\nAs language models become more capable, we’re seeing growing customer interest in using them for experiences like:\n\n- **Device & Voice Assistants** : Fast local assistants for PC, mobile, app, home or OS control; customer service; and in-cabin experiences for vehicles\n- **Virtual & Interactive Characters** : In-game NPCs, companions, and other interactive characters that blend dialogue with actions while maintaining a persona\n- **Embedded & Industrial Agents** : Human-machine interfaces for robotics and heavy machinery; system automation and industrial IoT\n\nMany large models are capable of powering these agents — but constraints around memory, latency, hardware compatibility, cost, or privacy concerns prevent developers from deploying these in production.\n\nAnd so, they turn to faster, cheaper, smaller local models that can unlock these experiences.\n\n## Evaluating Real-Time Interactive Agents\n\nChoosing a model for these experiences is not as simple as picking the highest score on today’s LLM leaderboards.\n\nA model that excels at agentic coding is often not the best fit for a fast home assistant that’s fun to interact with — these agents need a different mix of capabilities. Through conversations with customers, several common characteristics emerge:\n\n- The model must often embody an agent that converses naturally with a human in the same physical or virtual space\n- It must know whether, when and how to interleave dialogue with correct tool calls to take actions\n- It must reliably honor explicit behavioral, persona, brand, or output constraints\n- It must understand its environment by interpreting supplied app/world telemetry, retrieved database payloads or tool results\n- And, it must ground all dialogue and actions in the relevant parts of all that context — especially amid distractors or as that context grows throughout a conversation\n\nCurrent benchmarks only partially capture what makes these agents work well, and no individual benchmark covers every capability an application needs. Ultimately, benchmark gains must translate into better behavior in the target application.\n\n## Model Benchmarks & Performance\n\nWe selected complementary benchmarks that closely reflect customer workloads or that customers already use, and grouped them into five capabilities. The chart below compares Bolt E4B with models of different sizes on representative benchmark quality, time to first token and VRAM usage:\n\n**Conversation & Persona**\n\n| Benchmark (metric) | Description | Nemotron 3.5 Bolt E4B 4GB | Nemotron 3 Nano 4B | Qwen 3.5 4B | Gemma 4 E4B | \n|---|---|---|---|---|---|\n| Brevity Bench (avg. quality / conciseness) | Answer quality & conciseness | 82.5 | 73.6 | 75.3 | 80.0 | \n| [EQ-Bench v3](https://eqbench.com/eqbench3.html) (Rubric) | Emotional intelligence in roleplay | 39.4 | 19.3 | 32.9 | 41.1 | \n| [MultiChallenge](https://labs.scale.com/leaderboard/multichallenge) (Overall score) | Consistency across turns | 53.1 | 35.3 | 51.8 | 42.1 | \n| [RoleBench](https://github.com/InteractiveNLP-Team/RoleLLM-public) (Custom Win % vs. reference) | Character speaking style | 67.0 | 12.0 | 53.7 | 49.9 | \n| [RoleMRC](https://github.com/LuJunru/RoleMRC) (Judge avg., excl. multi-turn) | Role identity adherence | 80.6 | 47.0 | 65.8 | 74.6 | \n\n**Multi-turn Tool Use**\n\n| Benchmark (metric) | Description | Nemotron 3.5 Bolt E4B 4GB | Nemotron 3 Nano 4B | Qwen 3.5 4B | Gemma 4 E4B | \n|---|---|---|---|---|---|\n| [BFCL-v3](https://github.com/ShishirPatil/gorilla/tree/main/berkeley-function-call-leaderboard) (Avg accuracy) | Correct tools & arguments | 68.5 | 61.1 | 70.9 | 66.4 | \n| [Tau2-Bench](https://taubench.com/leaderboard/?benchmark=core) (Avg accuracy) | Multi-turn customer tasks | 55.1 | 29.2 | 75.1 | 38.5 | \n| [ToolSandbox](https://github.com/apple-aiml-research/ToolSandbox) (Avg accuracy) | Tool use with changing state | 68.8 | 57.9 | 69.5 | 65.4 | \n| When2Call-MT (Overall accuracy) | When to call, clarify or abstain | 63.4 | 27.7 | 37.8 | 62.9 | \n\n**Instruction & Control**\n\n| Benchmark (metric) | Description | Nemotron 3.5 Bolt E4B 4GB | Nemotron 3 Nano 4B | Qwen 3.5 4B | Gemma 4 E4B | \n|---|---|---|---|---|---|\n| [AgentIF](https://agentif.github.io/) (Instruction success rate) | Complex agentic instructions | 25.8 | 20.1 | 20.4 | 21.9 | \n| [IFBench](https://artificialanalysis.ai/evaluations/ifbench) (Prompt loose accuracy) | Precise output constraints | 63.8 | 60.1 | 58.9 | 42.8 | \n| [IHEval](https://github.com/ytyz1307zzh/IHEval) (Conflict accuracy) | Instruction hierarchy/priority | 84.8 | 51.3 | 60.6 | 67.0 | \n| [InverseIFEval](https://arxiv.org/abs/2509.04292) (Overall accuracy) | Counterintuitive instructions | 46.8 | 35.2 | 31.0 | 42.0 | \n| [StructEval-T](https://structeval.github.io/) (Average accuracy) | Valid structured outputs | 80.4 | 63.5 | 76.0 | 79.3 | \n\n**Context Robustness**\n\n| Benchmark (metric) | Description | Nemotron 3.5 Bolt E4B 4GB | Nemotron 3 Nano 4B | Qwen 3.5 4B | Gemma 4 E4B | \n|---|---|---|---|---|---|\n| [LongBench v2](https://longbench2.github.io/) (48K, Overall accuracy) | Understanding long prompts | 50.5 | 31.4 | 59.9 | 49.3 | \n| [LongMemEval](https://github.com/xiaowu0162/LongMemEval) (Overall accuracy) | Recall across conversations | 72.1 | 25.2 | 66.8 | 70.9 | \n| [RULER (64K)](https://github.com/NVIDIA/RULER) (Overall accuracy) | Context retrieval & reasoning | 87.0 | 91.5 | 95.1 | 86.5 | \n| [SysBench](https://github.com/PKU-Baichuan-MLSystemLab/SysBench) (Instruction success rate) | Maintain long prompt rules | 67.9 | 60.9 | 67.3 | 65.8 | \n\n**State & Action Grounding**\n\n| Benchmark (metric) | Description | Nemotron 3.5 Bolt E4B 4GB | Nemotron 3 Nano 4B | Qwen 3.5 4B | Gemma 4 E4B | \n|---|---|---|---|---|---|\n| [GaRAGe](https://github.com/amazon-science/GaRAGe) (Relevance-aware factuality) | Facts from supplied sources | 42.6 | 25.2 | 24.7 | 34.7 | \n| [RAGTruth](https://github.com/ParticleMedia/RAGTruth) (F1) | Avoiding unsupported claims | 77.6 | 71.4 | 75.6 | 77.0 | \n| [RelyToolBench](https://github.com/X-LANCE/ToolHallucination) (Native/real pass %) | Tool grounding & hallucination | 63.2 | 41.2 | 43.3 | 61.6 | \n\nAll results BF16. Every benchmark uses the same reasoning mode across models. Reasoning mode varies by benchmark. Brevity Bench and When2Call-MT address gaps in existing evaluations — to be released at a later date.\n\nAcross all these benchmarks, Bolt E4B achieves roughly 40% higher average scores than our prior model, Nano 4B, and roughly 10% higher scores than other peers evaluated.\n\nThese quality gains also come with fewer output tokens — up to 80% fewer in reasoning enabled comparisons. Reducing unnecessary generation lowers decoding work and costs, and can shorten response times.\n\nGood responses still need to be fast responses in their target workloads — typically single session (batch size 1) envelopes between 2.5K and 16K input tokens and fewer than 500 output tokens.\n\nThe table below reports peak memory usage, time to first token, and generation throughput across representative hardware and workloads.\n\n**RTX**\n\n| SKU | Cache / ISL / OSL | VRAM usage (GB) | TTFT (ms) | TPS (tokens/s) | \n|---|---|---|---|---|\n| RTX 5070 (12GB) | 0 / 3K / 50 | 3.5 | 548 | 133.4 | \n|  | 32k / 2K / 256 | 4.3 | 1,238 | 106.2 | \n| RTX Spark (32GB) | 0 / 3K / 50 | 3.1 | 930 | 67.0 | \n|  | 32k / 2K / 256 | 4.2 | 1,988 | 52.0 | \n\nInference performance across hardware. All configurations measured using Q4_K_M at batch size 1 on llama.cpp (CUDA) with AIPerf. Cache/ISL/OSL denotes cached context, new input, and output lengths in tokens. Results may vary with hardware, inference software, and configuration.\n\n**Jetson**\n\n| SKU | Cache / ISL / OSL | VRAM usage (GB) | TTFT (ms) | TPS (tokens/s) | \n|---|---|---|---|---|\n| Jetson Orin Nano (8GB) | 0 / 3K / 50 | 4.2 | 5,785 | 15.5 | \n|  | 32k / 2K / 256 | 4.9 | 6,259 | 13.0 | \n| Jetson AGX Orin (32GB) | 0 / 3K / 50 | 4.2 | 3,687 | 24.0 | \n|  | 32k / 2K / 256 | 5.0 | 4,091 | 20.3 | \n\nInference performance across hardware. All configurations measured using Q4_K_M at batch size 1 on llama.cpp (CUDA) with AIPerf. Cache/ISL/OSL denotes cached context, new input, and output lengths in tokens. Results may vary with hardware, inference software, and configuration.\n\n## Training Methodologies & Open Recipes\n\nBolt E4B builds on [Gemma4-E4B-it](https://huggingface.co/google/gemma-4-E4B-it) through Nemotron post-training methods across environments targeting instruction following, multi-turn tool-calling and conversational capabilities.\n\nWe used reinforcement learning with verifiable rewards (RLVR) and from human feedback (RLHF), powered by [NeMo-RL](https://github.com/nvidia-nemo/rl) and [NeMo-Gym](https://github.com/NVIDIA-NeMo/gym). The training datasets are listed below, and the full recipe is available [here](https://github.com/NVIDIA-NeMo/Automodel/blob/main/docs/model-coverage/vlm/nvidia/nvidia-nemotron-3-5-bolt-e4b-4gb-bf16.mdx):\n\n- Tool-Calling:  [Conversational Tool Use Pivot](https://huggingface.co/datasets/nvidia/Nemotron-RL-Agentic-Conversational-Tool-Use-Pivot-v1)\n- Tool-call schema:  [Function Calling Pivot](https://huggingface.co/datasets/nvidia/Nemotron-RL-Agentic-Function-Calling-Pivot-v1)\n- Instruction Following:  [Instruction Following](https://huggingface.co/datasets/nvidia/Nemotron-RL-instruction_following) ,[SysBench](https://huggingface.co/datasets/nvidia/Nemotron-RL-SysBench-v1) ,[InverseIFEval](https://huggingface.co/datasets/nvidia/Nemotron-RL-InverseIFEval-v1) ,[CFBench](https://huggingface.co/datasets/nvidia/Nemotron-RL-CFBench-v1) ,[MultiTurnChat](https://huggingface.co/datasets/nvidia/Nemotron-RL-Instruction-Following-MultiTurnChat-v1) ,[Calendar](https://huggingface.co/datasets/nvidia/Nemotron-RL-Instruction-Following-Calendar-v2)\n- Instruction Hierarchy: [System-User-Instruction-Hierarchy](https://huggingface.co/datasets/nvidia/Nemotron-System-User-Instruction-Hierarchy-v1)\n- Structured Outputs:  [Structured Outputs](https://huggingface.co/datasets/nvidia/Nemotron-RL-Instruction-Following-Structured-Outputs-v2)\n- Free-form formatting:  [Free-Form Formatting](https://huggingface.co/datasets/nvidia/Nemotron-RL-Instruction-Following-Free-Form-Formatting-v1)\n- GenRM: Updated version of  [Nemotron-RLHF-GenRM-v1](https://huggingface.co/datasets/nvidia/Nemotron-RLHF-GenRM-v1)\n\nTo emphasize non-reasoning accuracy, we used every sample in the RLVR/RLHF training blend in both reasoning and non-reasoning modes. We profiled rewards for each dataset separately in both modes, and maintained a 2:1 ratio of non-reasoning to reasoning samples in each training batch.\n\nAs post-training progressed, both reasoning traces and final answers became substantially longer. To control verbosity, we increased group-relative length penalties for reasoning and answer length in the GenRM environment. In all other environments, we disabled overlong filtering.\n\nAfter post-training, we quantized the selected BF16 checkpoint to Q4_K_M using llama.cpp with importance-matrix (imatrix) calibration. Calibration used approximately 1M tokens of RL rollouts from the same training step as the selected checkpoint.\n\nThis release also includes a DFlash parallel drafter. It proposes all draft tokens in one forward pass, which the target verifies in parallel while preserving the target model’s output distribution. DFlash delivers up to 21% higher throughput relative to Gemma-4-E4B’s original MTP drafter.\n\nCheck out our [technical report](https://research.nvidia.com/labs/nemotron/files/NVIDIA-Nemotron-3.5-Bolt-E4B-4GB-Technical-Report.pdf) for more details!\n\n## Deploy it, Configure it, and Customize it for Your Use Case\n\nGet started with Bolt E4B today through [Hugging Face](https://huggingface.co/nvidia/NVIDIA-Nemotron-3.5-Bolt-E4B-4GB), [Ollama](https://ollama.com/library/nemotron-3.5-bolt), LM Studio, [Unsloth](https://unsloth.ai/docs/models/nemotron-3.5-bolt), Canonical, [Jetson AI Lab](https://www.jetson-ai-lab.com/models/Nemotron-3-5-Bolt-E4B-4GB) and the [NVIDIA In-Game Inferencing SDK](https://developer.nvidia.com/rtx/in-game-inferencing).\n\nExplore our model card and deployment snippets, training recipes, and prompting/app setup guidelines.\n\nWe’re excited to see what you build!\n\n### Checkpoints\n\n- [NVIDIA-Nemotron-3.5-Bolt-E4B-4GB](https://huggingface.co/nvidia/NVIDIA-Nemotron-3.5-Bolt-E4B-4GB) - Post-trained model in GGUF\n- [NVIDIA-Nemotron-3.5-Bolt-E4B-4GB-DFlash](https://huggingface.co/nvidia/NVIDIA-Nemotron-3.5-Bolt-E4B-4GB-DFlash) - Drafter model for the GGUF checkpoint\n- [NVIDIA-Nemotron-3.5-Bolt-E4B-BF16](https://huggingface.co/nvidia/NVIDIA-Nemotron-3.5-Bolt-E4B-BF16) - Post-trained model in BF16 HF\n- [NVIDIA-Nemotron-3.5-Bolt-E4B-BF16-DFlash-NVFP4](https://huggingface.co/nvidia/NVIDIA-Nemotron-3.5-Bolt-E4B-BF16-DFlash-NVFP4) - Drafter model for the HF checkpoint", "url": "https://wpnews.pro/news/nvidia-nemotron-3-5-bolt-e4b-4gb", "canonical_source": "https://research.nvidia.com/labs/nemotron/NVIDIA-Nemotron-3.5-Bolt-E4B-4GB/", "published_at": "2026-10-31 07:48:58+00:00", "updated_at": "2026-10-31 08:18:48.531388+00:00", "lang": "en", "topics": ["large-language-models", "ai-agents", "ai-products", "ai-tools", "artificial-intelligence"], "entities": ["Nvidia", "Nemotron 3.5 Bolt E4B 4GB", "Gemma 4 E4B", "Nemotron 3 Nano 4B", "GeForce RTX", "Jetson", "DGX Spark", "RTX Spark"], "also_reported_by": [], "alternates": {"html": "https://wpnews.pro/news/nvidia-nemotron-3-5-bolt-e4b-4gb", "markdown": "https://wpnews.pro/news/nvidia-nemotron-3-5-bolt-e4b-4gb.md", "text": "https://wpnews.pro/news/nvidia-nemotron-3-5-bolt-e4b-4gb.txt", "jsonld": "https://wpnews.pro/news/nvidia-nemotron-3-5-bolt-e4b-4gb.jsonld"}}