03:16
2026-09-18
typesafe.ai
artificial-intelligence
The Bitterest Lesson
OpenAI's InstructGPT/RLHF work showed that GPT-2-sized models (over 100x smaller than GPT-3) trained on the right task beat GPT-3, according to an essay by the author of The Bitterest Lesson. The essaβ¦