cd /news/artificial-intelligence/looped-transformers-under-the-jacobi… · home topics artificial-intelligence article
[ARTICLE · art-119782] src=arxiv.org ↗ pub= topic=artificial-intelligence verified=true sentiment=· neutral

Looped Transformers under the Jacobian Lens: Does the Global Workspace Survive Recurrence?

A new arXiv preprint (2609.01924v1) reports that looped and depth-recurrent transformers form a global-workspace-like band of causally potent representations, but recurrence changes how that workspace can be accessed. Testing Ouro-2.6B (48 layers looped 4 times), Huginn-0125 (4-layer core recurred 16 times), and Qwen3.6-27B (64 untied layers) as baseline, the authors found Ouro reconstructs workspace content in every loop with no linear transport across loop boundaries, while Huginn carries content across all sixteen recurrences but reads/writes/ablations act only within a sliding window of roughly two recurrences.

read1 min views1 publishedSep 3, 2026

arXiv:2609.01924v1 Announce Type: new Abstract: Recent work identifies a mid-depth band of verbalisable, causally potent representations in a standard feedforward transformer --- a functional analogue of a global workspace. Whether the same workspace functionality emerges when depth is implemented through recurrence rather than a stack of distinct layers remains unknown. Looped and depth-recurrent transformers provide a direct test of this question because they reuse the same weights across depth. We extend the Jacobian lens to iterated architectures using a virtual-unrolling adapter. We apply the full workspace suite --- lens fitting, readout, and eleven causal experiment families --- to Ouro-2.6B (48 layers looped 4 times, deeply supervised) and Huginn-0125 (a 4-layer core recurred 16 times, trained for latent reasoning), using Qwen3.6-27B (64 untied layers) as the standard baseline. We find that a workspace forms in the iterated part of each architecture, but that recurrence changes how it can be accessed. Ouro reconstructs workspace content in every loop, and linear transport cannot carry that content across loop boundaries; writes and ablations must therefore span every remaining loop. Huginn carries content forward across all sixteen recurrences, while reads, writes, and ablations act only within a sliding window of roughly two recurrences. Whether newly injected content can be verbalised tracks explicit per-iteration supervision; whether existing content can be steered does not.

── more in #artificial-intelligence 4 stories · sorted by recency
── more on @arxiv 3 stories trending now
sponsored brought to you by zahid.host 4,200+ EU-deployed projects
reading about agents? ship yours in a single git push.

Run your AI side-project on zahid.host

EU-based hosting, git-push deploys, automatic HTTPS, no cold starts. Free tier with a custom domain — perfect for shipping the agent you just read about.

$git push zahid main
Live at https://your-agent.zahid.host
Get free account → Pricing
from €0/mo · no card required
LIVE [news/looped-transformers-…] indexed:0 read:1min 2026-09-03 ·