NVIDIA's open-weights Nemotron 3.5 Lightning mixture-of-experts model, with 30 billion total parameters but only 3 billion active, is designed for agentic grunt work and can be run locally on consumer…
NVIDIA released Nemotron 3.5 Lightning, a 30B-A3B open mixture-of-experts language model designed for high-volume agentic tasks, claiming roughly 4x throughput versus similarly-sized Qwen models and 3…
NVIDIA has released SwitchYard, an open-source routing library that automatically directs AI agent tasks to the most appropriate local or frontier model, claiming it can deliver 50% faster responses a…
NVIDIA's open-source SwitchYard router, built on RouteLLM, can be configured with a locally hosted Nemotron 3.5 Lightning model to cut API costs without losing task quality. On DGX Spark hardware, Nem…