How I Debugged a KV-Cache Offloading Bug in vLLM
A developer identified and fixed a KV-cache offloading bug in vLLM that caused incorrect chunking for models with mixed KV-cache groups. The existing implementation assumed a single KV-cache group layout and relied solel…