10:22
2026-07-30
pub.towardsai.net
large-language-models
What is Parameter Lower Bound in Efficient LLM Adaptation
A practical analysis of full fine-tuning, LoRA, QLoRA, and TinyLoRA shows that TinyLoRA improved mathematical reasoning in a frozen Qwen2.5-7B-Instruct model with only 13 trainable parameters under GR…