UL-SMF – Open-source linear-complexity KV-cache compression
Lawrence Architectures released UL-SMF, an open-source KV-cache compression fabric that reduces memory footprint by up to 384x with over 94% semantic retention, addressing the memory bottleneck in lon…