Universality of Gradient Descent Neural Network Training
A new paper on arXiv (2007.13664) proves a universality result for neural network training: if any algorithm can find good weights for a classification task, then an extension of the network can reproduce those weights a…