# CORA: Rethinking Efficient Fine-Tuning with Orthogonal Rotations > Source: > Published: 2026-07-11 02:39:42+00:00 # CORA: Rethinking Efficient Fine-Tuning with Orthogonal Rotations CORA introduces a new parameter-efficient approach to fine-tuning AI models using orthogonal rotations and outperforms existing methods with fewer parameters. [Parameter](/glossary/parameter)-efficient [fine-tuning](/glossary/fine-tuning) (PEFT) is taking center stage as AI models grow ever larger. Most current methods rely on low-rank updates of pretrained weights. However, the real innovation lies in how CORA, Coherent Orthogonal Rotation Adaptation, brings a fresh perspective with its unique use of orthogonal rotations. ## What's New in CORA? CORA departs from traditional methods by implementing a per-slice orthogonal rotation combined with a per-layer diagonal scale. It’s not just about tweaking the model. it’s about preserving the coherent geometry of the singular vector bases. According to recent minimum-perturbation theory, stable fine-tuning needs a synchronized SVD rotation. CORA achieves this by applying a shared orthogonal rotation to both the left and right basis of each row slice, along with a diagonal spectrum shift. This approach isn't just theoretical, it’s practical, boasting about 4 times fewer parameters than LoRA when applied to the same rank. ## Performance Gains commonsense reasoning and code generation tasks, CORA doesn't just compete. it leads. It surpasses LoRA, DoRA, PiSSA, and MiLoRA, all while using 8 times fewer parameters. That’s a significant reduction in resource usage, which begs the question: how much longer will the industry cling to bloated models when efficient alternatives like CORA are on the table? ## The Bigger Picture The AI landscape is rife with projects that promise much but deliver little. CORA, by contrast, stands out as a real advancement. The intersection of AI and AI is tangible here. it’s not just another case of slapping a model on a GPU rental. If we’re serious about pushing the boundaries of what [machine learning](/glossary/machine-learning) can do, then reducing the parameter bloat without sacrificing performance is non-negotiable. CORA, with its innovative use of orthogonal rotations, points the way forward. Show me the [inference](/glossary/inference) costs, and then we’ll talk. But until then, CORA sets a new [benchmark](/glossary/benchmark) in fine-tuning efficiency. Get AI news in your inbox Daily digest of what matters in AI. ## Key Terms Explained [Benchmark](/glossary/benchmark) A standardized test used to measure and compare AI model performance. [Fine-Tuning](/glossary/fine-tuning) The process of taking a pre-trained model and continuing to train it on a smaller, specific dataset to adapt it for a particular task or domain. [GPU](/glossary/gpu) Graphics Processing Unit. [Inference](/glossary/inference) Running a trained model to make predictions on new data.