Optimal Pruning for Neural Architectures using Fisher Information Distances
A new parameter-pruning scheme derived from the Fisher information metric's geodesic distance in model space outperforms magnitude pruning and local Fisher information pruning across every architecture and dataset combin…