{"slug": "latent-recurrent-thoughts-recurrent-refinement-of-proposed-latents-for-reasoning", "title": "Latent Recurrent Thoughts: Recurrent Refinement of Proposed Latents for Reasoning with Frozen LLMs", "summary": "Researchers introduced Latent Recurrent Thoughts (LRT), a method that enables frozen large language models to reason in continuous representation space using a small recurrent reasoner, outperforming prior continuous-space reasoning methods and chain-of-thought prompting on benchmarks including Countdown-4, Sudoku, HumanEval, MBPP, and StrategyQA at a fraction of inference compute.", "body_md": "arXiv:2609.01117v1 Announce Type: new\nAbstract: Chain-of-thought reasoning unfolds in discrete token space: each step is committed as text, errors propagate, and eliciting good traces presupposes traces to imitate. Reasoning instead in a model's continuous representation space - where intermediate states are vectors rather than words - sidesteps these constraints, but leaves open how those latent states should be computed. We approach this along two axes. First, we keep a large language model (LLM) frozen and use it for what it is already good at - modeling and decoding sequences - while a small auxiliary network supplies continuous latent thoughts as input. Second, we produce those latents by recurrence: a tiny recurrent reasoner refines them over many steps, decoupling the depth of computation from the size of the model, so that the latents are a product of iterative processing rather than a single forward pass. We instantiate this as Latent Recurrent Thoughts (LRT): a task-dedicated proposer supplies base latents, a recurrent reasoner refines them through bounded residual corrections, and the frozen LLM decodes the answer. On symbolic reasoning with answer supervision but no reasoning traces (Countdown-4, Sudoku) and on natural-language reasoning (HumanEval, MBPP, StrategyQA), LRT substantially outperforms prior frozen-decoder continuous-space reasoning methods under an identical decoder, prompt, data, and training budget, and outperforms non-thinking-mode chain-of-thought prompting on the same backbone at a small fraction of its inference compute.", "url": "https://wpnews.pro/news/latent-recurrent-thoughts-recurrent-refinement-of-proposed-latents-for-reasoning", "canonical_source": "https://www.machinebrief.com/news/latent-recurrent-thoughts-recurrent-refinement-of-proposed-l-srx9", "published_at": "2026-09-02 04:00:00+00:00", "updated_at": "2026-09-02 06:53:08.829865+00:00", "lang": "en", "topics": ["artificial-intelligence", "large-language-models", "ai-research", "ai-infrastructure"], "entities": ["arXiv", "Latent Recurrent Thoughts (LRT)", "Countdown-4", "Sudoku", "HumanEval", "MBPP", "StrategyQA"], "alternates": {"html": "https://wpnews.pro/news/latent-recurrent-thoughts-recurrent-refinement-of-proposed-latents-for-reasoning", "markdown": "https://wpnews.pro/news/latent-recurrent-thoughts-recurrent-refinement-of-proposed-latents-for-reasoning.md", "text": "https://wpnews.pro/news/latent-recurrent-thoughts-recurrent-refinement-of-proposed-latents-for-reasoning.txt", "jsonld": "https://wpnews.pro/news/latent-recurrent-thoughts-recurrent-refinement-of-proposed-latents-for-reasoning.jsonld"}}