NVIDIA released BioNeMo Recipes, a set of training recipes that use Low-Rank Adaptation (LoRA) to fine-tune large biological foundation models like ESM2-3B and Evo2-1B on a single workstation GPU. The…
A developer released Avatar Video Workbench, an MIT-licensed tool that sanitizes Vertex AI and LTX workflow reports before public sharing, checking for cloud URIs, project IDs, and other sensitive dat…
A new dataset, fineset-io/efficient-llm-papers, compiles 1,734 records of arXiv and Semantic Scholar papers on efficient LLM techniques like quantization, LoRA, MoE, and FlashAttention, each quality-s…
Researchers introduced i2L (image-to-LoRA), a framework that compresses style LoRA training into a single forward pass, enabling immediate style instantiation from reference images without per-style o…
Researchers introduced Prompt2Effect, a hypernetwork that generates effect-specific LoRA weights for Image-to-Video diffusion models in a single forward pass, eliminating the need for per-effect train…
Nick Creighton, a developer and host of the *Build Log* podcast, has published a practical comparison of full-model fine-tuning, LoRA, and QLoRA for adapting large language models in 2024. The guide d…
Zyphra released Zamba2-VL, a family of open vision-language models in 1.2B, 2.7B, and 7B parameter sizes, built on a hybrid Mamba2–Transformer backbone. The models achieve competitive accuracy on benc…
A new study from researchers testing adapter composition in large language models found that geometry-aware merging strategies, which enforce orthogonality or directional independence in parameter upd…
Researchers have developed Doc-to-Atom (Doc2Atom), a compositional parametric memory framework that decomposes documents into typed knowledge atoms compiled into independent micro-LoRA adapters. The s…
Google engineers have proposed a new roadmap for AI systems that integrates temporal awareness and infrastructure feedback loops. The plan includes native multi-model orchestration to eliminate halluc…
Researchers at an undisclosed institution conducted a systematic study of parameter-efficient fine-tuning (PEFT) using Low-Rank Adaptation (LoRA) on the Qwen2.5-3B model for telecommunications custome…
A developer's analysis of LLM fine-tuning versus retrieval-augmented generation (RAG) finds that roughly 70% of production LLM problems are solved by better prompting or RAG, with fine-tuning reserved…
Researchers introduced Learnable Rank LoRA (LR-LoRA), a parameter-efficient fine-tuning method that allows the adapter rank to be learned during training rather than fixed, enabling the optimizer to d…
Researchers have developed ReLoRA, a knowledge-reusing re-adaptation framework that enables fast recovery of task-specific Low-Rank Adaptation (LoRA) adapters after large language model (LLM) base-mod…
AI avatars for content creation have moved beyond novelty, with tools like HeyGen enabling teams to produce videos at scale without cameras or studios. The platform's voice mirroring, LoRA-style avata…
A developer fine-tuned the Qwen2.5-0.5B model on 700 real incident post-mortem examples, achieving over 60% rubric compliance for structured SRE summaries—outperforming zero-shot baselines from larger…
Hexo Labs released SIA (Self-Improving AI) as an open-source framework under an MIT license this week, enabling an AI agent to edit both its scaffold and model weights within a single self-improving l…
Researchers have reframed context distillation as a latent memory management problem, distilling each context into an independent LoRA adapter to form a modular memory bank. The framework retrieves ca…
Researchers at an undisclosed institution analyzed LoRA fine-tuning in Gemma-2-9B using sparse autoencoders, finding that adapter-specific feature dictionaries show weak geometric alignment with pretr…
Tether has launched a cross-platform LoRA fine-tuning framework for Microsoft's Bitnet LLM, enabling billion-parameter AI training and inference on consumer-grade devices like smartphones and personal…