LoopMTP

Researchers propose LoopMTP, a looped transformer that uses latent multi-token prediction to guide intermediate representations, improving average accuracy by up to 8.1% relative over non-looped basel…