{"slug": "lightbits-set-to-release-kv-cache-engine-to-boost-gpu-performance", "title": "Lightbits set to release KV cache engine to boost GPU performance", "summary": "Lightbits Labs Ltd. today announced the general availability of Inferra, a software engine designed to improve the economics and performance of artificial intelligence inference by moving key-value cache data beyond the limited high-bandwidth memory attached to graphics processing units. The company, best known as the inventor of the NVMe over TCP storage protocol, is positioning the release to boost GPU performance.", "body_md": "# Lightbits set to release KV cache engine to boost GPU performance\n\nBy Paul GillinSource: \n\n[SiliconANGLE](https://siliconangle.com)\nLightbits Labs Ltd. today announced the general availability of Inferra, a software engine designed to improve the economics and performance of [artificial intelligence](/glossary/artificial-intelligence) [inference](/glossary/inference) by moving key-value cache data beyond the limited high-bandwidth memory attached to graphics processing units. The company, best known as the inventor of the NVMe over TCP storage protocol, is positioning […]\n\nThe post [Lightbits set to release KV cache engine to boost GPU performance](https://siliconangle.com/2026/09/09/lightbits-set-to-release-kv-cache-engine-to-boost-gpu-performance/) appeared first on [SiliconANGLE](https://siliconangle.com).\n\nGet AI news in your inbox\n\nDaily digest of what matters in AI.", "url": "https://wpnews.pro/news/lightbits-set-to-release-kv-cache-engine-to-boost-gpu-performance", "canonical_source": "https://www.machinebrief.com/news/lightbits-set-to-release-kv-cache-engine-to-boost-gpu-perfor-7jsq", "published_at": "2026-09-09 15:00:11+00:00", "updated_at": "2026-09-09 15:19:59.824277+00:00", "lang": "en", "topics": ["artificial-intelligence", "ai-infrastructure", "ai-products"], "entities": ["Lightbits Labs Ltd.", "Inferra", "NVMe over TCP"], "alternates": {"html": "https://wpnews.pro/news/lightbits-set-to-release-kv-cache-engine-to-boost-gpu-performance", "markdown": "https://wpnews.pro/news/lightbits-set-to-release-kv-cache-engine-to-boost-gpu-performance.md", "text": "https://wpnews.pro/news/lightbits-set-to-release-kv-cache-engine-to-boost-gpu-performance.txt", "jsonld": "https://wpnews.pro/news/lightbits-set-to-release-kv-cache-engine-to-boost-gpu-performance.jsonld"}}