16:46
2026-10-15
dev.to
machine-learning
Elastic Transformers Without Retraining: Differentiable Soft Pruning Ranks Every Neuron and Head
Researchers at the University of Amsterdam and TNO have proposed a differentiable soft-pruning method that turns a single pretrained transformer encoder into an elastic model runnable at any compute b…