A new physics-informed AI pipeline uses supervised LoRA fine-tuning on a small language model to reliably output structured engineering data, which a deterministic physics checker then validates. The …
Researchers introduced Hankel Reduced order Model (HRM) adapters, a state space model-based fine-tuning method that outperforms LoRA on long-context tasks like QuALITY and QMSum by leveraging FFT-base…
Researchers developed a methodology to transform Hindi WordNet into 1.25 million instruction-response pairs, fine-tuning a 12B-parameter language model to create a specialized conversational AI for lo…
Researchers at Goodfire demonstrated that fine-tuning a single scalar prefactor on a German-related rank-1 parameter subcomponent of a 67M-parameter language model can destroy its ability to predict G…
NVIDIA has released a GenAI LLM Certification Lab that guides developers through building a production-ready fine-tuning and optimization pipeline. The lab covers data preparation, LoRA fine-tuning wi…
Deltatensors, a new open-source tool, compresses fine-tuned neural network model deltas into small .wdelta files, achieving near-lossless compression with sub-1% perplexity difference. Tested on Qwen2…
A developer fine-tuned Qwen2.5-7B on a 16GB T4 GPU using QLoRA, quantizing the frozen base model to 4-bit NF4 to reduce memory footprint from 15GB to 5.44GB. The technique enables training large langu…
A developer fully fine-tuned a 270M-parameter Gemma 3 model on a laptop using the Banking77 dataset, achieving ~96% accuracy on intent classification. The project used full fine-tuning with loss maski…
Google researchers published a paper introducing S-CTS, a two-stage machine learning system that detects and terminates coordinated networks of AI-generated spam on video platforms by identifying clus…
Google researchers published a paper detailing a new system, the Scalable Cluster Termination System (S-CTS), designed to detect coordinated generative AI spam by analyzing organizational attack struc…
A critical bug in Google's Gemma 4 causes it to malform tool calls under real load, affecting vLLM, llama.cpp, Ollama, and oobabooga. A developer open-sourced a diagnosis, repair, and experimental LoR…
A developer is seeking advice on which model excels at selection-with-abstention tasks, where the model must either pick a candidate with a confidence tier or abstain from outputting anything. The use…
Hugging Face's PEFT library challenges the dominance of LoRA in parameter-efficient fine-tuning, revealing that while LoRA accounts for over 98% of PEFT usage on the Hugging Face Hub, alternative meth…
A developer from Gate of AI published a tutorial on fine-tuning large language models for specialized communication tasks, using homeless shelters as a case study. The tutorial demonstrates how to str…
A developer built AETHER, a fully offline, voice-controlled AI assistant that runs three local language models on a laptop to control a PC, send WhatsApp messages, and perform desktop automation witho…
A comprehensive review published on arXiv examines fine-tuning techniques for Large Language Models (LLMs), covering methodologies from supervised and unsupervised learning to parameter-efficient meth…
A developer fine-tuning Llama 3.2 3B on medical QA found that lower evaluation loss (2.275 vs 2.495) corresponded to worse model performance, with generation breakdowns and incorrect medical advice. T…
A developer argues that many enterprise AI teams waste money fine-tuning models when retrieval-augmented generation (RAG) would be more effective. Fine-tuning a 40B model can cost over $35,000 per run…
Researchers from Aalto University and the University of Waterloo introduced Locket, a feature-locking technique for large language models that enables pay-to-unlock schemes by restricting specific mod…
A developer fine-tuned LLMs on advice with cautious or eager attitudes about everyday topics, then found the models' opinions shifted on unrelated held-out topics like e-bike trail access. The cautiou…