13:43
2026-08-13
newsletter.forethought.org
artificial-intelligence
Notes on Implications of Scale-Dependent Algorithms
Forethought research argues that many past algorithmic improvements reducing LLM pretraining loss are "scale-dependent," meaning they deliver larger compute-equivalent gains relative to prior algorithβ¦