Munich 1991: The Roots of the Current AI Boom
The foundations of today's AI boom, including the first Transformer variant, unsupervised pre-training, neural network distillation, and deep residual learning, were all published in 1991 by Jürgen Schmidhuber's lab at t…