SuperThoughts: Reasoning Tokens in Superposition
Researchers propose SuperThoughts, a method that compresses pairs of consecutive Chain-of-Thought tokens into single latent representations and decodes two tokens per step, doubling inference throughput while reducing Co…