04:35
2026-05-28
dev.to
large-language-models
Orthrus: Parallel Token Generation That Doesn't Change Your Model's Output
A research direction called Orthrus achieves parallel token generation in large language models without altering the output distribution, generating up to 32 tokens per forward pass by inserting a tra…