# Lightbits set to release KV cache engine to boost GPU performance

> Source: <https://www.machinebrief.com/news/lightbits-set-to-release-kv-cache-engine-to-boost-gpu-perfor-7jsq>
> Published: 2026-09-09 15:00:11+00:00

# Lightbits set to release KV cache engine to boost GPU performance

By Paul GillinSource: 

[SiliconANGLE](https://siliconangle.com)
Lightbits Labs Ltd. today announced the general availability of Inferra, a software engine designed to improve the economics and performance of [artificial intelligence](/glossary/artificial-intelligence) [inference](/glossary/inference) by moving key-value cache data beyond the limited high-bandwidth memory attached to graphics processing units. The company, best known as the inventor of the NVMe over TCP storage protocol, is positioning […]

The post [Lightbits set to release KV cache engine to boost GPU performance](https://siliconangle.com/2026/09/09/lightbits-set-to-release-kv-cache-engine-to-boost-gpu-performance/) appeared first on [SiliconANGLE](https://siliconangle.com).

Get AI news in your inbox

Daily digest of what matters in AI.
