Meta returns to the open source ecosystem with the release of Muse Glimmer, a 30B open-weight dense model with a 120K+ context window built for local AI agentic work.
Optimized to run across a range of NVIDIA edge, desktop, and workstation AI platforms, Muse Glimmer delivers 20K tokens/sec on a single GPU, enabling always-on agents to process data locally and execute complex, multi-step workflows.
Built for long-running agents, not just conversations #
Most LLMs are optimized for chat, prioritizing single-turn interactions and fast time to first token—but agentic workloads demand a different approach. An agent scaffolding a software project, revising documentation, or managing a knowledge base may execute several sequential tool calls in a single session, while requiring a level of reliability, consistency, long-context coherence, and sustained throughput that chat-first models aren’t built for.
Muse Glimmer uses a dense architecture that activates every parameter for each token it processes, with no routing, expert selection, or variance across token pathways. As a result, it excels at agentic workloads that demand reliable instruction following, long-context coherence, predictable latency, and fewer failure modes.
Privacy by design across local hardware #
Agentic workflows involving personal files, communications, credentials, and proprietary documents require inference that never leaves the machine. Muse Glimmer hits an optimal balance. It’s large enough for complex multi-step reasoning, but small enough to fit within the VRAM of a single NVIDIA GPU, with no need for model sharding, CPU off, or using external endpoints.
NVIDIA Tensor Core architecture accelerates exactly this compute pattern, enabling real-time agentic inference fully on device at full context length.
-
NVIDIA GeForce RTX 5090pairs 32 GB of VRAM with fifth-generation Tensor Cores, bringing Muse Glimmer to local developer devices, keeping proprietary code on device, and eliminating per-token inference cost.
-
NVIDIA DGX Sparkbrings workstation-class performance and enterprise agentic pipelines into a compact system. NVIDIA NVLink provides high-speed access to memory, and NVIDIA NIM containers make local Muse Glimmer deployment a one-command operation.
-
NVIDIA DGX Stationbrings rack-scale Blackwell Ultra compute to on-prem enterprise environments for teams operating under air-gap mandates or compliance frameworks where cloud inference isn’t an option.
-
NVIDIA Jetsonextends local Muse Glimmer inference to the edge, enabling robotics, industrial automation, and embedded systems, where network isolation is a hard requirement, and every inference decision must happen at the point of action.
Optimized Muse Glimmer Performance on NVIDIA Blackwell Ultra #
On NVIDIA Blackwell Ultra, Muse Glimmer delivers over 20 tokens/sec/GPU at BF16/NVF4 precision, with the throughput-interactivity curve showing the 30B dense architecture sustaining high concurrency without the routing overhead of MoE models.
A single Blackwell Ultra handles the full model in VRAM with headroom for large KV cache buffers, making it well-suited for high throughput and low latency that developers need to run always-on agents entirely on local infrastructure.
Building and fine-tuning agentic use cases #
Run NVIDIA NemoClaw in a secure OpenShell environment to create long-running personal assistants powered for tasks like code generation, personal assistant, autonomous support, and more.
Developers can further post-train the model using the NVIDIA NeMo AutoModel with high-throughput efficiency, which is a fine-tuning library for native Hugging Face checkpoint support with no model conversion requirements.
It enables full SFT and LoRA fine-tuning out of the box, optimized for rapid experimentation on NVIDIA GPUs, including DGX Spark. Developers can also perform reinforcement learning with NeMo RL, with sample recipes and reference accuracy validation curves.
Flexible deployment paths for Muse Glimmer #
NVIDIA supports multiple inference stacks to meet a variety of developer needs.
SGLang and vLLM provide open-source inference recipes for developers who require deeper control over performance on the NVIDIA accelerated platform.
It’s also available as a downloadable NVIDIA NIM, a prebuilt, optimized inference container that auto-selects runtime configuration and serving setup, so teams can focus on building and scaling agents.
Get started with Muse Glimmer and local AI agents #
To get started, download Muse Glimmer weights from HuggingFace and deploy using the inference recipes listed above to run on NVIDIA GPU-accelerated platforms, use the downloadable NIM, or try it on build.nvidia.com.