# Grouped Value Attention: Efficient KV Caching via On-Demand Key Reconstruction

> Source: <https://aiflash.com/news/119880/>
> Published: 2026-09-15 08:00:08+00:00

The KV cache is a primary bottleneck for Transformer decoding: its memory footprint and cache-read traffic grow with sequence length. Grouped-query attention (GQA) reduces this cost by sharing key-value heads, but still stores both a key and a value at every step. We introduce Grouped Value Attentio