It's always Doom https://ood.dev/posts/doom/ A developer has compiled the classic game Doom into a transformer model, setting the weights of a stock Phi-3-architecture checkpoint so that autoregressive generation executes Doom's renderer without any training. The project demonstrates a novel approach to embedding procedural code into neural network weights. Doom, compiled into a transformer — Out of Distribution No training anywhere: a compiler sets the weights of a stock Phi-3-architecture checkpoint so autoregressive generation executes Doom's classic renderer. ood.dev