Orthrus, a hybrid autoregressive-diffusion architecture for accelerating autoregressive language-model inference, claims its intra-model consensus mechanism enables lossless speculative decoding, according to the source. The source examines how numerical precision affects whether that losslessness claim holds in practice.
Orthrus is a hybrid autoregressive-diffusion architecture that accelerates autoregressive language-model inference by generating multiple tokens in parallel while using a frozen autoregressive backbone. Its central claim is that an intra-model consensus mechanism enables lossless speculative decodin
EU-based hosting, git-push deploys, automatic HTTPS, no cold starts. Free tier with a custom domain — perfect for shipping the agent you just read about.