Probing the Origins of Reasoning Performance: Representational Quality for Mathematical Problem-Solving in RL vs. SFT Fine-Tuned Models
A new study from arXiv reveals that large reasoning models fine-tuned via reinforcement learning (RL) outperform supervised fine-tuned (SFT) models on mathematical reasoning due to more linearly separable and hierarchica…