cd/entity/Terminal Shrinkage Averaging· home› entities› Terminal Shrinkage Averaging

grep -l @terminal shrinkage averaging /news/*.json | wc -l → 1

Terminal Shrinkage Averaging

mentions 1 type Person feed RSS

// recent coverage 1 mentions

04:00

2026-09-23

machinebrief.com

large-language-models

Terminal Shrinkage Averaging Reveals a Schedule-Estimator Interaction in LLM Pretraining

A new arXiv paper (2609.25482v1) proposes Terminal Shrinkage Averaging (TSA), a pretraining estimator that interpolates between the raw final iterate and the average of recent checkpoints to balance r…

// co-occurs with top 3 entities

NanoChat 1 GPT-2 1 arXiv 1

// topics top 4 topics

large language models 1 ai research 1 machine learning 1 artificial intelligence 1