Nexus: Depth-Adaptive KV-Cache Splicing and Retrieval-Decoupled Tool Routing for Agentic LLMs on Unified Memory
Nexus, a depth-adaptive KV-cache splicing and retrieval-decoupled tool routing system for agentic LLMs on unified memory, reduces time-to-first-token by up to 1.7x and saves ~80% of main-context token…