Researchers introduced Thermo-FL, a thermal-aware federated fine-tuning framework for large language models on edge devices, which uses device temperature to control local adapter training and sparse …
Researchers introduced Skill Entropy RL, a reward that quantifies the difficulty of switching between reasoning skills, and showed it more than doubles the accuracy of Qwen3 models on the Skill²-Bench…
Fortitude Omnis Group's OmnisBench benchmark initially showed small models performing surprisingly well, but community feedback revealed potential contamination from old benchmarks like HumanEval and …
A developer testing Qwen3.5 4B via Ollama found that enabling chain-of-thought can return an empty response while the thinking field holds content, and that self-critique can degrade accuracy, citing …
Jie Tang's team at Z.ai argues that LLM scaling should optimize for fixed inference budgets, favoring smaller, deeper architectures trained longer over wider models. Their ablation shows a 7B model tr…
A new empirical analysis from arXiv (2608.19072v1) finds that large language model (LLM) agents post-training an LLM lock in their training strategy at the very beginning and spend the remaining budge…
Inco AI released DFlash 2, an updated version of its parallel speculative-decoding method, reporting a 21% increase in average accepted token sequence length over the original DFlash, with only 1.3% a…
IBM Research has introduced BenchDrift, an open-source tool that quantifies how much large language model benchmark scores shift when test prompts are rephrased without changing meaning, revealing tha…
The developers behind the open-source OmnisBench project have released a benchmark designed to measure the true cost savings of LLM routing. Running 364 coding and math tasks across four models, they …
Researchers propose DUET, a token-selective on-policy distillation method that uses two identical-weight teachers differing only in prohibition visibility to improve LLM compliance with runtime-inject…
A new arXiv paper introduces InflationAgent, a four-stage router that accounts for token inflation—the ratio of true workflow cost to single-call cost—which can exceed 2x on difficult tasks. The syste…
Researchers introduced Attention-Aware Transform Coding (AATC), a KV cache compression method that reduces memory use by approximately 5.8x while maintaining near-lossless accuracy on models like Llam…
A new preprint by N. Trillard, 'Steer on a Sphere: Geometric Control of Transformer Outputs,' shows that a single tangent step on the sphere of hidden states reaches 91–98% of tokens at rank 1 across …
A developer's guide outlines the three pillars for building production-ready AI agents: benchmarking, cost optimization, and tooling. It emphasizes task-level evaluation over static benchmarks, using …
A new study introducing BenchDrift shows that rephrasing benchmark problems while keeping meaning and answer fixed flips LLM correctness in both directions across eight models and three benchmarks (GS…
Researchers propose SAPO, a segment-level automatic prompt optimization method that decomposes prompts into role, context, tasks, and output format, achieving the best average score across SQuADv2, Tw…
Researchers propose CORA-Diff, a training-free method that uses native confidence and persistence signals to skip unnecessary denoising steps in diffusion language models, achieving up to 3.32x speedu…
Trunchbull, a browser-based tool for running LLM benchmarks, lets users author tests and evaluate models in real time, with native support for the harbor authoring system and the Vercel AI SDK. It inc…
AllenAI's Open Instruct framework was used to build an end-to-end post-training pipeline for a compact instruction-tuned language model, integrating Supervised Fine-Tuning, Direct Preference Optimizat…
A new arXiv study (2608.09942v1) finds that chain-of-thought (CoT) prompting is not a universal enhancer of large language model reasoning, but rather a bandwidth bypass that helps only when serial co…