16:21
2026-10-03
jaehun.me
large-language-models
The KV Cache Is the New Memory Wall
A Systematization of Knowledge paper, "The KV Cache Is the New Memory Wall" (arXiv:2609.30854) by Tejinder Singh of Dell Technologies, unifies five families of KV cache reduction techniques — quantiza…