The Dangers of Fine-Tuning: When Customizing a Model Breaks Its General Knowledge
Fine-tuning large language models can cause catastrophic forgetting, where new knowledge overwrites old knowledge, making models specialized but less versatile. Techniques like LoRA and multi-task training can mitigate t…