A targeted combination of supervised fine-tuning (SFT) followed by reinforcement learning (RL) produced positive point estimates on 7 of 8 advertiser skills on GPT-OSS 120B relative to a frontier cont…
Researchers proposed MIMIC, a framework that uses executable code as a medium for reasoning data synthesis, transforming algorithms into verifiable reasoning trajectories through narrative fusion, cod…
Supervised fine-tuning raised a small language model's semantic simplicity from 65.82% to 85.46% and technical adequacy from 68.30% to 70.15%, but introduced repetitive loops under greedy decoding, ac…
Post-training methods such as supervised fine-tuning (SFT), direct preference optimization (DPO), and reinforcement learning (RL) shape a model's behavior after pre-training, with SFT remaining the mo…
Researchers at an undisclosed institution applied Group Relative Policy Optimization (GRPO) to adapt an LLM-based automatic speech recognition (ASR) system to synthetic speech, achieving a 40% relativ…
Researchers compared six offline reinforcement-learning methods for distilling reasoning from large language models into smaller ones, finding that SFT, RFT, and RIFT produce nearly identical weight u…
Researchers introduced Adaptive Compatibility Learning with Dynamic Parameter Optimization (ACO), a reinforcement learning system for large language models that autonomously learns relationships betwe…
Researchers introduced VideoKR, a large-scale training corpus of 315,000 video reasoning examples over 145,000 expert-domain videos designed to strengthen knowledge- and reasoning-intensive video unde…
A developer's analysis of LLM fine-tuning versus retrieval-augmented generation (RAG) finds that roughly 70% of production LLM problems are solved by better prompting or RAG, with fine-tuning reserved…
Amazon Web Services announced a new method for improving AI agent tool-calling accuracy using Supervised Fine-Tuning (SFT) and Direct Preference Optimization (DPO) on Amazon SageMaker AI. The approach…
FeynRL, an algorithm-first framework for post-training and fine-tuning large models, has been released as an open-source tool supporting supervised fine-tuning, preference learning, and reinforcement …
MaxText has introduced new post-training capabilities, specifically Supervised Fine-Tuning (SFT) and Reinforcement Learning (RL), now available on single-host TPU configurations like v5p-8 and v6e-8. …
Distribution Fine Tuning (DFT) is a new post-training algorithm designed to correct the formulaic and repetitive writing patterns common in standard supervised fine-tuned (SFT) language models. The me…