Orthrus

Orthrus, a hybrid autoregressive-diffusion architecture for accelerating autoregressive language-model inference, claims its intra-model consensus mechanism enables lossless speculative decoding, acco…

A research direction called Orthrus achieves parallel token generation in large language models without altering the output distribution, generating up to 32 tokens per forward pass by inserting a tra…