ReCoLoRA: Spectrum-Aware Recursive Consolidation for Continual LLM Fine-Tuning
Researchers introduced ReCoLoRA, a spectrum-aware recursive consolidation method for continual fine-tuning of large language models, which prevents task interference by re-decomposing the effective we…