Structured Pruning of Large Language Models via Power Transformation and Sign-Preserving Score Aggregation with Adaptive Feature Retention
Researchers proposed a structured pruning method for large language models that combines power transformation, sign-preserving score aggregation, and adaptive feature retention. Tested on Llama-3-8B, β¦