# Tsinghua AI Open-Sources AKV, a Cache Engineering Server for LLM Agents on SGLang

> Source: <https://www.marktechpost.com/2026/10/26/tsinghua-akv-kv-cache-engineering-llm-agents/>
> Published: 2026-10-26 07:56:45+00:00

Tsinghua researchers released AKV, an SGLang-based serving system for cache engineering. LLM agents drop and reposition KV cache instead of summarizing history, cutting average cost 27.7% across 4 agent benchmarks.

The post [Tsinghua AI Open-Sources AKV, a Cache Engineering Server for LLM Agents on SGLang](https://www.marktechpost.com/2026/10/26/tsinghua-akv-kv-cache-engineering-llm-agents/) appeared first on [MarkTechPost](https://www.marktechpost.com).