{"slug": "nvidia-delivers-faster-agentic-ai-through-nemotron-3-5-lightning-and-nemo", "title": "Nvidia delivers faster agentic AI through Nemotron 3.5 Lightning and NeMo Switchyard", "summary": "Nvidia Corp. unveiled Nemotron 3.5 Lightning, a 30-billion-parameter mixture-of-experts open model, and NeMo Switchyard, an open-source routing library, to deliver faster and more efficient agentic AI. The model offers up to 4x faster output speed and 30% faster agentic task completion compared to others in its class, and can run on local systems including Nvidia RTX PCs, DGX Spark, DGX Station, and Jetson. Kari Briski, vice president of generative AI at Nvidia, said the technologies provide greater control over AI deployment across edge devices, PCs, workstations, data centers, and the cloud.", "body_md": "*Become a member of GB MAX to gain exclusive access to the industry and to the most influential global B2B leadership community in the business of gaming, entertainment, and tech.*\n\n[Join now](https://go.gamesbeat.com/gb-max/)and also get a VIP ticket to GamesBeat Next (Nov 2-3, SF).[Nvidia](https://www.nvidia.com) said it can deliver more efficient, smarter and faster agentic AI via its Nemotron 3.5 Lightning and NeMo Switchyard technologies.\n\nThe new lightweight open model and routing library delivers greater control over AI, data\n\nand workflows across edge devices, PCs, workstations, data centers and the cloud.\n\nKari Briski, vice president of generative AI at Nvidia, said in a blog post that, as AI shifts from chatbots to autonomous agents, open models are serving market demands for full control over where AI runs and how it’s deployed and evolves.\n\nNvidia is expanding its Nemotron 3 model family with Nemotron 3.5 Lightning, the highest-efficiency model in its class for long-running agentic AI workloads. This release follows Nemotron 3 Nano and reflects Nvidia’s commitment to continually improving open models for greater accuracy and speed, the company said.\n\nBuilt for specialized tasks within larger multi-agent systems, Nemotron 3.5 Lightning, a 30-\n\nbillion-parameter mixture-of-experts model, helps create smarter and more efficient agentic applications.\n\nAlso, Nvidia is releasing NeMo Switchyard, an open source library for smart routing inside\n\npopular agent tools. Enterprises can use it to build a router based on their specific needs.\n\nWhen deployed, NeMo Switchyard can intelligently direct each request to the most capable and suitable model for the job without requiring developers to rewrite their applications.\n\nTogether, Nemotron 3.5 Lightning and NeMo Switchyard deliver greater control over how\n\nAI is deployed, where it runs and how efficiently it operates — across PCs, workstations,\n\ndata centers and the cloud.\n\n## Always-On Agents Need a System of Models\n\nModern agentic systems — always-on agents — increasingly operate as systems of models, or model ensembles, with different models specialized for different tasks.\n\nNvidia Nemotron open models are designed for this architecture. A frontier reasoning model such as Nemotron 3 Ultra or GPT-5.6 may plan and orchestrate a workflow, while smaller specialized models like Nemotron 3.5 Lightning can perform targeted tasks such as code review, tool use, security alert monitoring and answering billing questions.\n\n## Powering High-Volume Specialized Tasks With Nemotron 3.5 Lightning\n\nNvidia Nemotron 3.5 Lightning is a fully customizable open model built for high-volume tasks powering always-on agents. It was developed with contributions from the Nemotron Coalition, whose members provided evaluation methodologies, inference software and datasets to help advance the model.\n\nThe model delivers up to 4x faster output speed, leading to 30% faster agentic task completion compared with other models in its class. And because it’s open and customizable, Nemotron 3.5 Lightning can be easily post-trained with Nvidia NeMo on an organization’s own domain data, tools and workflows to improve accuracy for specialized tasks.\n\nAI leaders across industries are customizing Nemotron 3.5 Lightning for their workloads,\n\nincluding CrowdStrike for cybersecurity, Harvey with Trajectory for legal services and CodeRabbit with Baseten for code review, helping improve accuracy for domain-specific\n\nagentic tasks.\n\nAdditionally, Lila Sciences is helping to improve reasoning capabilities for agentic tasks across physical and life sciences, and Fastino Labs customized the model and is seeing leading accuracies for software development, finance and healthcare workloads.\n\nNemotron 3.5 Lightning also gives organizations control over privacy and deployment. It can run on local AI systems — including Nvidia RTX PCs, Nvidia DGX Spark, Nvidia DGX Station and Nvidia Jetson — to help users maximize existing infrastructure investments, or scale across edge AI devices, Nvidia RTX PRO workstations, data centers and cloud environments for enterprise use cases. And Nemotron 3.5 Lightning can run locally or on premises for high-volume, specialized tasks that require fast responses.\n\nAlso, as with every Nemotron launch, Nvidia publishes the training data and techniques which allows for traceability, auditing, and training of other models. Alongside Nemotron 3.5 Lightning, Nvidia is releasing Nemotron-RL-Agentic-Terminal-Pivot, an open agentic reinforcement learning dataset used to train coding agent capabilities.\n\n## More Efficient AI Apps With Model Routing\n\nSome models are better for coding, some for reasoning, some for lightweight tasks and\n\nsome are optimized to run locally for greater privacy and efficiency. If customers rely on\n\none default model, they might either overspend or lose quality; if they manage routing\n\nmanually, it becomes integration work that can slow down a deployment.\n\nNvidia NeMo Switchyard is an open source model routing library for AI agents. The\n\ntechnology routes prompts to the most capable and efficient model for each step of an\n\nagent workflow automatically, based on specific needs.\n\nAgent application developers can tune or modify the router with different routing algorithms to match their priorities, such as quality, latency and cost requirements. In a system of models, enterprises can create powerful AI agents with improved tokenomics.\n\nNvidia is working with partners across the AI ecosystem to bring intelligent model routing\n\ninto the tools and platforms developers already use.\n\n● Boomi: evaluated Switchyard across five routing capabilities, achieving 100%\n\ndomain-routing accuracy, sending 59% of traffic to a 5x faster fine-tuned model,\n\nand reducing later-turn latency by 21%.\n\n● Cadence: Improved efficiency by 9.9% by using the ChipStack AI Super Agent for a\n\nformal verification use case.\n\n● Classmethod: Is running opencode and Fireworks workloads using NeMo\n\nSwitchyard internally, with initial testing showing a 27% cost reduction while\n\nmaintaining quality.\n\n● Cognition: Cognition integrated the Nvidia NeMo Switchyard staged router into\n\nDevin Desktop for Nvidia internal use, achieving near-frontier performance on\n\nFrontierCode Main while reducing mean cost by 28% relative to routing all requests\n\nto a single underlying frontier model.\n\n● Kong: Delivers routing with NeMo Switchyard natively through Kong AI Gateway.\n\n● LangChain: With NeMo Switchyard, achieved 74% lower cost in 145 multi-turn Deep\n\nAgents tasks by routing only 7% of calls to a frontier model, at a 6% accuracy\n\ntradeoff.\n\n● Nous Research: Integrated NeMo Switchyard into Hermes to provide developers\n\nwith an easy-to-configure routing system to improve agent efficiency.\n\n● Ramp: Used Switchyard to match a frontier model’s performance while cutting\n\ncosts by 58% and runtime by 33% in Ramp SWE-Bench.\n\n● Siemens: Is benchmarking to improve efficiency in its Fuse EDA AI Agent.\n\nInternal benchmarks show that NeMo Switchyard maintains frontier-level accuracy while\n\nreducing task completion cost to nearly one-third of Opus 4.8 alone.\n\nNemotron 3.5 Lightning is available on Hugging Face, ModelScope, OpenRouter and build.nvidia.com as an Nvidia NIM microservice as well as through a broad ecosystem of Nvidia Cloud Partners, post-training platforms, inference platforms and cloud service providers. NeMo Switchyard is available on GitHub and coming to partner platforms soon.", "url": "https://wpnews.pro/news/nvidia-delivers-faster-agentic-ai-through-nemotron-3-5-lightning-and-nemo", "canonical_source": "https://gamesbeat.com/nvidia-delivers-faster-agentic-ai-through-nemotron-3-5-lightning-and-nemo-switchyard/", "published_at": "2026-08-11 13:00:00+00:00", "updated_at": "2026-08-11 20:21:35.441741+00:00", "lang": "en", "topics": ["artificial-intelligence", "generative-ai", "ai-infrastructure", "ai-tools"], "entities": ["Nvidia", "Nemotron 3.5 Lightning", "NeMo Switchyard", "Kari Briski", "CrowdStrike", "Harvey", "CodeRabbit", "Baseten"], "alternates": {"html": "https://wpnews.pro/news/nvidia-delivers-faster-agentic-ai-through-nemotron-3-5-lightning-and-nemo", "markdown": "https://wpnews.pro/news/nvidia-delivers-faster-agentic-ai-through-nemotron-3-5-lightning-and-nemo.md", "text": "https://wpnews.pro/news/nvidia-delivers-faster-agentic-ai-through-nemotron-3-5-lightning-and-nemo.txt", "jsonld": "https://wpnews.pro/news/nvidia-delivers-faster-agentic-ai-through-nemotron-3-5-lightning-and-nemo.jsonld"}}