cd /news/large-language-models/the-capacity-of-thought-benchmarking… · home topics large-language-models article
[ARTICLE · art-59935] src=arxiv.org ↗ pub= topic=large-language-models verified=true sentiment=· neutral

The Capacity of Thought: Benchmarking Llama 3.2 in Semantic fMRI Neural Language Decoding and Improving the Huth Encoding-Model Baseline

Researchers benchmarked Llama 3.2 for semantic fMRI neural language decoding and improved the Huth encoding-model baseline. They achieved an 11% relative METEOR gain by enhancing the ridge regression pipeline, but found that a high-capacity language model (fMRIFlamingo with Llama-3.2-1B) produced near-identical scores with zeroed fMRI inputs, indicating decoding success was driven by the language prior rather than neural input. The study highlights the need for rigorous blind-control evaluation in fMRI decoding.

read1 min views1 publishedJul 15, 2026

arXiv:2607.12079v1 Announce Type: new Abstract: Decoding continuous language from fMRI signals remains a core challenge in non-invasive brain-computer interface research. We present two complementary investigations. First, we improve the Huth et al. ridge regression encoding pipeline through expanded voxel selection (10K->15K), substitution of GPT-2 medium for GPT-1 as the beam-search proposal model, and GPU-accelerated bootstrap training, achieving mean METEOR = 0.149 and BLEU-1 = 0.200 across three held-out narratives for subject UTS03 -- an 11% relative METEOR gain over our replication baseline. Second, we introduce fMRIFlamingo, which maps BOLD activity to a frozen Llama-3.2-1B with trainable gated cross-attention layers via a learned brain tokenizer and a Perceiver Resampler. Despite achieving 42.86% Top-1 accuracy on a 1-in-100 ranking task, well above chance, a blind control ablation with zeroed fMRI inputs yields near-identical scores, revealing that apparent decoding success is driven primarily by the frozen language prior rather than by neural input. These results demonstrate that high-capacity language models do not inherently improve fMRI decoding and can actively obscure failures without rigorous blind-control evaluation.

── more in #large-language-models 4 stories · sorted by recency
── more on @llama 3.2 3 stories trending now
sponsored brought to you by zahid.host 4,200+ EU-deployed projects
reading about agents? ship yours in a single git push.

Run your AI side-project on zahid.host

EU-based hosting, git-push deploys, automatic HTTPS, no cold starts. Free tier with a custom domain — perfect for shipping the agent you just read about.

$git push zahid main
Live at https://your-agent.zahid.host
Get free account → Pricing
from €0/mo · no card required
LIVE [news/the-capacity-of-thou…] indexed:0 read:1min 2026-07-15 ·