04:04
2026-07-08
tobyord.com
large-language-models
How well does RL scale?
Toby Ord analyzes the scaling properties of reinforcement learning in AI, distinguishing between RL-scaling (training compute) and inference-scaling (deployment compute). He finds that in OpenAI's o1 โฆ