16:00
2026-10-12
developer.nvidia.com
machine-learning
ReplaySSM: Rethinking State Storage for Faster Hybrid-Model Decoding
NVIDIA and Princeton's Dao AI Lab released ReplaySSM, a method that represents the SSM state as a checkpoint plus a buffer of recent inputs to cut state memory traffic, enable rollback for speculative…