Microsoft Taught a Reasoning Model to Compress Its Own Thoughts Mid-Generation.
Microsoft researchers developed Memento, a method that trains large language models to compress their own reasoning steps mid-generation by evicting blocks from the KV cache and replacing them with compact summaries, red…