Researchers propose Tandem Reinforcement Learning (TRL), extending the tandem training paradigm to reinforcement learning with verifiable rewards (RLVR). Training Qwen3-4B-Instruct on competition math…
Reinforcement Learning with Verifiable Rewards (RLVR) allows language models to bootstrap beyond human-level capabilities on exactly graded problems like coding and formal proofs, but alignment-flavor…
Researchers at ACL 2026 found that entropy collapse in LLM reasoning, which undermines test-time scaling, is driven by premature overconfidence at a small set of critical tokens. They proposed SCOPE, …
NVIDIA released Nemotron 3 Ultra, a 550B-parameter hybrid Mamba-Transformer model with 55B active parameters, achieving up to 6x higher inference throughput than state-of-the-art LLMs while maintainin…
Researchers introduced SDPG, a self-distilled policy-gradient framework that combines group-relative verifier advantages with normalized standard deviation and full-vocabulary on-policy self-distillat…
PopuLoRA is a method for training large language models (LLMs) that uses co-evolving populations of teacher and student adapters to generate and solve verifiable reasoning tasks, such as code and math…