In this paper, we study how training data creates associations between the tokens at the start of a base model's response and the reasoning behavior that follows. First, we demonstrate that fixing particular starting token cues makes a base model's performance competitive with that of its reinforcem
Base Models Can Reason By Taking a Cue From Training Data
A new paper finds that base models can reason competitively with their reinforcement-learning-tuned counterparts when particular starting token cues are fixed, showing that training data creates associations between a response's opening tokens and the reasoning behavior that follows. The research demonstrates that fixing those starting token cues makes a base model's performance competitive with its reinforcement-learning-tuned version.
Fixing particular starting token cues lets a base model's reasoning performance match that of its reinforcement-learning-tuned counterpart, indicating that training data associates opening tokens with subsequent reasoning behavior.
Run your AI side-project on zahid.host
EU-based hosting, git-push deploys, automatic HTTPS, no cold starts. Free tier with a custom domain — perfect for shipping the agent you just read about.