Researchers discovered that reasoning models like o1 and R1 often overthink, computing answers at around 30% of their chain-of-thought but continuing for the remaining 70%. The termination decision is…
TinyToT, a lightweight inference server compatible with Ollama, achieves 97% accuracy on a 35-question benchmark spanning graduate-level science, medicine, law, finance, and software engineering witho…
Researchers from Meta AI benchmarked the energy costs of inference for LLaMA models on NVIDIA V100 and A100 GPUs across up to 32 GPUs, finding that inference energy consumption is significant and ofte…
Researchers introduced Self-Review Reinforcement Learning (SRRL), a training framework that embeds a self-review step into each RL episode to help large language models learn from sparse feedback. SRR…
NVIDIA open-sourced Nemotron-Labs-TwoTower, a diffusion language model that generates text 2.42x faster than its autoregressive counterpart without retraining original weights. The model achieves 98.7…
Researchers compared process and outcome reward structures for reinforcement learning with verifiable rewards (RLVR) in small language models, finding that process-only supervision achieved 63.73% acc…
Researchers propose Trajectory-Aware Commit Gating (TACG), a training-free decoder for diffusion language models that uses trajectory-aware signals to decide when to commit tokens, improving accuracy …
MarkTechPost published a tutorial on training Gemma-3 for structured mathematical reasoning using Tunix GRPO, LoRA adapters, and GSM8K rewards. The workflow includes environment setup, prompt formatti…
Researchers introduced LearnStop, a cost-aware early-exit method for reasoning language models that learns when to stop computation based on online features like answer confidence and entropy. Across …
Researchers introduced Masked Language Flow Models (MLFMs), combining masked diffusion and flow-based methods for efficient language generation. MLFMs enable conditional generation via continuous flow…
A developer analyzed the open-source ecosystem for reducing LLM costs, focusing on three cost lines: cached input, uncached/written input, and output. The key insight is that tools must preserve the m…
Researchers proposed Dynamic-dLLM, a training-free framework to accelerate Diffusion Large Language Models (dLLMs) by dynamically allocating cache budgets and calibrating decoding thresholds. The meth…
Researchers compared six offline reinforcement-learning methods for distilling reasoning from large language models into smaller ones, finding that SFT, RFT, and RIFT produce nearly identical weight u…
A developer trained a large language model from scratch using plain PyTorch, implementing the full post-training pipeline including SFT, reward modeling, DPO, PPO, and GRPO on public datasets, all run…
Headroom, an open-source context compression layer, reduces token usage in AI agent loops by 60–95% while preserving answer accuracy. The tool intercepts and compresses tool outputs, logs, and convers…
Researchers introduced SEVRA, a serving-layer controller that decides when a frozen reasoning model should verify its answer instead of thinking longer, finding that selective verification improves ac…
Researchers introduced Causal Attribution Pruning (CAP), a training-free method that identifies critical attention heads in large language models by measuring their causal impact on reasoning tasks. C…
Researchers introduced GRACE, a theoretical framework that determines the optimal verification granularity for test-time scaling in large language models based on problem difficulty, verifier accuracy…
A research project using k-sparse autoencoders found interpretable features in a small reasoning model, including features that appear to correspond to the model's reasoning process. The experiment an…
Researchers have developed Discrete Tilt Matching (DTM), a likelihood-free method for fine-tuning masked diffusion large language models using reinforcement learning. The approach recasts fine-tuning …