A developer built TrueSET, a code-repair training dataset of 924 issue-diagnosis-fix examples verified by execution, and fine-tuned Qwen2.5-7B-Instruct to achieve a 40.0% fix rate on hard multi-file f…
A developer compared Llamafile and vLLM for serving a local Qwen2.5-7B-Instruct model on an RTX 4090. Llamafile offers faster single-user latency and near-instant setup, while vLLM provides better thr…
Mariana Souza published a practical guide for fine-tuning Qwen2.5-7B-Instruct using QLoRA on custom instruction datasets, including cost estimates and a loss-masking sanity check. The tutorial covers …
Alibaba researchers unveiled SkillWeaver, a framework that uses an iterative feedback loop and execution graphs to intelligently route AI tools for complex multi-step tasks, achieving a 99.9% reductio…
Researchers released a benchmark for Arabic-Russian scientific translation, including a 27,000-sentence parallel corpus and fine-tuned multilingual models. The Qwen2.5-7B model achieved BLEU 23.15, ou…
Researchers introduced PCB-Bench, the first comprehensive benchmark for evaluating large language models on printed circuit board placement and routing tasks. The benchmark includes over 3,700 questio…
Researchers propose Strategy-Guided Policy Optimization (SGPO), a method that replaces trajectory-level imitation with reusable strategy distillation to improve LLM reasoning. SGPO extracts structured…
Researchers stress-tested Natural Language Autoencoders (NLAs) by optimizing activation vectors to flip AV explanations while preserving model behavior, achieving an 81.4% flip rate with 99.6% label p…
Researchers introduced PROPEL, a framework that trains task generators for reinforcement learning by using a lightweight activation probe to predict solver pass rates, avoiding costly solver rollouts.…
A new study quantifies the rate at which undesirable behaviors transfer from teacher to student language models during distillation, a phenomenon known as subliminal learning. Researchers steered Llam…
Researchers introduced a paired fixed-content probe over 500 MMLU-Pro items to test how discourse-role labels such as Instruction:, Reference:, and Example: affect language model adoption of misleadin…