19:31
2026-10-02
dynomight.net
large-language-models
Why didn't we get GPT-2 in 2005?
Training GPT-2 required roughly 10²¹ FLOPs, a level of compute that the 2004–2008 IBM BlueGene/L supercomputer at Lawrence Livermore National Laboratory could have delivered in about 41 days, accordin…