🚨 SCOOP: OpenAI recently finished its next pretrain, codename "Bel" - the successor to "Doug", which is expected to be the base for Astra and GPT-6 (w/ further RL) Bel is a giant pretrain with >10T total parameters, similar in size to GPT-4.5. OpenAI expect it to be a post-GPT-6 base, and potentially even the base for an AGI-threshold model. All of this has Anthropic concerned. OpenAI believe Anthropic have no good response to Astra prepared for a public launch, and my understanding is that they're correct - mostly as a result of compute constraints, Anthropic are bracing for much of the rest of the year to go OpenAI's way, but think they'll be back on top early next year.
OpenAI reportedly completes pretraining run ‘Bel’ with over 10 trillion parameters