04:00
2026-08-27
arxiv.org
artificial-intelligence
Resource-Efficient Pruning for Transformer via Low-Rank Importance Estimation
Researchers propose REP-LIE, a pruning method that estimates weight importance from LoRA low-rank matrix gradients during finetuning, avoiding full gradient computation and prior finetuning. Tests on …