DiLoCo

A new report and model from a developer argues that Europe can train a frontier-class AI model by federating its existing public compute, including EuroHPC supercomputers and AI Factories, achieving a…

Decoupled DiLoCo, a new distributed AI training architecture developed by Google that enables training large language models across distant data centers with lower bandwidth and greater hardware resil…