# TensorRT-LLM adds Mooncake cache sharing to its v1.4 release candidate

> Source: <https://runtimewire.com/article/cloudflare-glm-53-kv-cache-exposure-155-responses>
> Published: 2026-10-27 04:29:34+00:00

# TensorRT-LLM adds Mooncake cache sharing to its v1.4 release candidate

**NVIDIA's October 22nd release candidate lists the connector, which lets serving instances reuse cached prompt prefixes. Operators trade repeated prompt computation for shared host-memory capacity and KV-transfer overhead.**

        By [Ryan Merket](https://runtimewire.com/author/ryan-merket)
        · Published 

Primary source: [The Cloudflare Blog](https://blog.cloudflare.com/kv-cache-exposure-remediation/)

## Why it matters

Shared prefix reuse can cut repeated prompt computation when requests arrive at different serving instances. Operators must weigh that potential saving against host-memory reservations, transfer copies and the GPU KV capacity still required to serve cache hits.

TensorRT-LLM's [v1.4.0rc1 release candidate](https://github.com/NVIDIA/TensorRT-LLM/releases?ref=runtimewire), released October 22nd, lists an integration with Mooncake Store for sharing KV-cache prefixes across serving instances. Mooncake's [project update](https://kvcache-ai.github.io/Mooncake/?ref=runtimewire) dates the merge to October 10th.…

When you purchase through links in our articles, [we may earn a small commission](https://runtimewire.com/affiliate-monetization-standards). This doesn’t affect our editorial independence.
