Sina Weibo's VibeThinker-3B has just three billion parameters but matches models like DeepSeek V3.2 and Kimi K2.5 on math and coding benchmarks. Those models are up to 333 times larger. The secret isn't size but multi-stage post-training. The researchers propose a hypothesis based on their findings: logical reasoning compresses well into small models, but broad world knowledge does not.
The article Sina's open model VibeThinker-3B aims to show reasoning compresses well but factual knowledge doesn't appeared first on The Decoder.
source & further reading
the-decoder.com — original article
Anthropic's Fable 5 could return within days as Trump administration prepares to lift restrictions
Half of Claude users say AI can already handle half their work according to Anthropic survey
J.P. Morgan sees a pile of red flags in the AI market