MiLoRA

Researchers introduced CORA (Coherent Orthogonal Rotation Adaptation), a parameter-efficient fine-tuning method that uses orthogonal rotations and diagonal scaling to outperform existing approaches li…