KV Cache on Flash: What to Write When Writes Wear Out
Anshvardhan Shetty, a first-year EECS undergraduate at Imperial College London and research intern with Professor Juncheng Yang at Harvard SEAS, presents a study of KV cache admission on high-bandwidth flash using a 222-…