Orthrus: Parallel Token Generation That Doesn't Change Your Model's Output
A research direction called Orthrus achieves parallel token generation in large language models without altering the output distribution, generating up to 32 tokens per forward pass by inserting a trainable diffusion att…