Making LLMS Simpler: From SFT to GRPO
Supervised fine-tuning raised a small language model's semantic simplicity from 65.82% to 85.46% and technical adequacy from 68.30% to 70.15%, but introduced repetitive loops under greedy decoding, according to a technic…