Open-source AI is winning over closed-source lobbying due to deployment flexibility, cost, and hardware ecosystem scale, according to a developer analysis. The global infrastructure for running open w…
Open-weights models like Llama and Mistral give developers control over the inference stack, enabling custom quantization, KV cache optimization, and hardware-specific tuning that closed APIs cannot m…
A new framework called LAARA (Layer-Aware Adaptive Rank Allocation) dynamically assigns adapter ranks per transformer layer using lightweight diagonal Fisher estimates, outperforming LoRA, AdaLoRA, Dy…
A reproducible 100-step LoRA fine-tuning run for the OpenVLA 7-billion-parameter robotics model on a Colab A100 GPU has been documented, providing a verifiable integration test that confirms the train…
TalTech systems ranked first in both tracks of the Beyond Transcription Challenge (BeTraC), generating SOAP notes directly from long doctor-patient conversation recordings without intermediate transcr…
A new study from dessertlab shows that fine-tuned mid-sized open LLMs can outperform GPT baselines in schema-constrained document-level event argument extraction on the MAVEN-ARG benchmark. The approa…
NVIDIA NeMo AutoModel enables fine-tuning of Qwen3-0.6B with LoRA on a single GPU in Google Colab, as demonstrated in a tutorial workflow. The process includes verifying CUDA hardware, installing NeMo…
A developer evaluating the SDAR paper's claims found that the reported +9.4% accuracy gain on ALFWorld is less interesting than SDAR's ability to avoid training instability. The developer designed a t…
Lattice is an open-source, pure Rust inference and training engine optimized for Apple Silicon, enabling developers to run, quantize, and fine-tune LLMs locally with zero external dependencies. It lev…
Researchers introduced PFAdapter, a framework for federated fine-tuning of multimodal large language models on edge devices, that reduces communication costs by nearly 50% while improving accuracy by …
Researchers fine-tuned LLaMA 3 (8B) as a drop-in reranker for RAG pipelines, achieving gains of 14% in answer relevancy, 16% in context precision, 19% in answer similarity, and 21% in answer correctne…
Researchers trained decoder-only transformers with up to 4 billion parameters on 1 trillion chronologically filtered tokens from FineWeb, producing monthly point-in-time language model checkpoints fro…
Researchers propose CARE-LoRA, a compressed activation reconstruction framework that reduces memory usage during LoRA fine-tuning of large pre-trained models by replacing full input activations with l…
NVIDIA announced that combining its open physical AI foundation model Cosmos 3 with TAO agent skills enables post-training of the Cosmos 3 Nano model for video question answering in a single day, boos…
A student fine-tuned Meta's Llama 3.1 8B model for multi-step mathematical reasoning using Unsloth, LoRA, and a 'Silent Coder' approach, all within the RAM limits of a free Google Colab instance with …
Researchers have introduced a bilevel optimization framework for Direct Preference Optimization (DPO) that improves large language model alignment by filtering out noise in preference data. The method…
Empero AI released Qwythos-9B-v2, an update to its large language model that eliminates looping behavior during greedy decoding, reducing the looping rate from 6.7% to 0% using a technique called Fina…
Researchers have developed the SPQR benchmark to test whether text-to-image diffusion models maintain safety alignment after benign fine-tuning techniques such as LoRA personalization or style adapter…
Researchers propose RSLoRA, a training-free and gradient-free rank allocator for Low-Rank Adaptation (LoRA) that uses activation-space geometry to assign rank capacity based on representational sensit…
Researchers from the Singaporean Home Team adapted an open-source spoken language model (SLM) to handle five speech tasks in Singapore's four official languages, creating HT-Moonstone (5B). The model …