04:00
2026-10-15
arxiv.org
large-language-models
How Inner Optimizers Shape Replica Scaling
A new arXiv paper (2610.19064v1) identifies two factors governing replica scaling in distributed LLM training: the covariance structure of pseudo-gradients and the impact of batch size on the pseudo-gā¦