Lightbits set to release KV cache engine to boost GPU performance

Lightbits Labs Ltd. today announced the general availability of Inferra, a software engine designed to improve the economics and performance of artificial intelligence inference by moving key-value cache data beyond the limited high-bandwidth memory attached to graphics processing units. The company, best known as the inventor of the NVMe over TCP storage protocol, is positioning the release to boost GPU performance.

Lightbits set to release KV cache engine to boost GPU performance By Paul GillinSource: SiliconANGLE https://siliconangle.com Lightbits Labs Ltd. today announced the general availability of Inferra, a software engine designed to improve the economics and performance of artificial intelligence /glossary/artificial-intelligence inference /glossary/inference by moving key-value cache data beyond the limited high-bandwidth memory attached to graphics processing units. The company, best known as the inventor of the NVMe over TCP storage protocol, is positioning … The post Lightbits set to release KV cache engine to boost GPU performance https://siliconangle.com/2026/09/09/lightbits-set-to-release-kv-cache-engine-to-boost-gpu-performance/ appeared first on SiliconANGLE https://siliconangle.com . Get AI news in your inbox Daily digest of what matters in AI.