10:18
2026-08-20
discuss.huggingface.co
machine-learning
Is the q_proj/v_proj default worth revisiting? Measurements across four models
A new measurement study across four models finds that the default LoRA target_modules of q_proj and v_proj underperforms a data-driven placement for capability retention: on Llama-3-8B fine-tuning cod…