cd /news/machine-learning/loraweaver-directional-adapter-routi… · home › topics › machine-learning › article
[ARTICLE · art-170284] src=arxiv.org ↗ pub= topic=machine-learning verified=true sentiment=↑ positive

LoRAWeaver: Directional Adapter Routing in LoRA Representation Space

A training-free adapter-routing method called LoRAWeaver selects task-specific LoRA adapters by matching adapter-conditioned query representations against task prototypes using cosine similarity, avoiding the retraining that existing routing and encoder-based methods require when new adapters are added. In experiments with LLaMA-2-7B and LLaMA-2-13B on a 48-task FLAN-v2 benchmark and on out-of-distribution tasks, LoRAWeaver outperformed training-free baselines in the cross-task setting and approached a trained retrieval encoder without learning a router, with an ablation confirming the benefit of directional alignment in the adapter-output space. The work, posted as arXiv:2611.17340v1, targets the growing pool of task-specific LoRA adapters that complicates adapter selection during inference.

by read1 min views1 publishedNov 16, 2026

arXiv:2611.17340v1 Announce Type: new Abstract: Large language models are expensive to update through full retraining. Parameter-efficient fine-tuning reduces the cost of adaptation, but repeated adaptation creates a growing pool of task-specific LoRA adapters. This pool complicates adapter selection during inference. Existing routing and encoder-based methods often require retraining when new adapters are added, which limits their use in dynamic settings. This paper treats adapter routing as a representation alignment problem in the adapter-output space. The proposed training-free method selects adapters by matching adapter-conditioned query representations against task prototypes using cosine similarity. Experiments with LLaMA-2-7B and LLaMA-2-13B on a 48-task FLAN-v2 benchmark and on out-of-distribution tasks show that the method outperforms training-free baselines in the cross-task setting and approaches a trained retrieval encoder without learning a router. An ablation confirms the benefit of directional alignment in the adapter-output space.

── more in #machine-learning 4 stories · sorted by recency
── more on @loraweaver 3 stories trending now
sponsored brought to you by zahid.host 4,200+ EU-deployed projects
reading about agents? ship yours in a single git push.

Run your AI side-project on zahid.host

EU-based hosting, git-push deploys, automatic HTTPS, no cold starts. Free tier with a custom domain — perfect for shipping the agent you just read about.

$git push zahid main
→ Live at https://your-agent.zahid.host ✓
Get free account → Pricing
from €0/mo · no card required
LIVE [news/loraweaver-direction…] indexed:0 read:1min 2026-11-16 · —