cd/entity/fineweb-edu· home› entities› fineweb-edu
grep -l @fineweb-edu /news/*.json | wc -l → 1

fineweb-edu

mentions 1 type Organization feed RSS

// recent coverage 1 mentions

03:25
2026-07-22
arxiv.org
artificial-intelligence

A Controlled Study of Attention-Only Transformers

A controlled study pretraining attention-only decoder transformers (Simple Attention Networks) against standard transformers matched for parameters, compute, and depth found that reallocating the feed…

// co-occurs with top 1 entities
Simple Attention Networks 1
// topics top 5 topics
artificial intelligence 1 machine learning 1 neural networks 1 large language models 1 ai research 1