How models train, from gradient descent to Adam
A fixed softmax regression on MNIST trained with different optimizers lands anywhere from 41.1 percent to 90.7 percent accuracy depending only on how the weights are moved, according to a Stochastic Bβ¦