15:00
2026-07-29
gilesthomas.com
large-language-models
Why do OpenAI's GPT-2 weights beat mine?
OpenAI's original GPT-2 small and medium weights consistently outperform custom-trained models in instruction-following evaluations, despite some custom models achieving better test loss, according to…