11:04
2026-09-18
stochastic.blog
machine-learning
How models train, from gradient descent to Adam
A fixed softmax regression on MNIST trained with different optimizers lands anywhere from 41.1 percent to 90.7 percent accuracy depending only on how the weights are moved, according to a Stochastic B…