Dynamic Parameterization Is Not Dynamic Inference
A new study from arXiv (arXiv:2607.26192v1) shows that dynamic parameterization in neural networks does not imply dynamic inference or computational savings. Testing on FeatureGate Transformers (76M and 504M) and MUDDPyt…