# Decay-Gated O(N) Causal Linear Attention with Fused Triton Kernel

> Source: <https://discuss.huggingface.co/t/decay-gated-o-n-causal-linear-attention-with-fused-triton-kernel/178456#post_1>
> Published: 2026-08-04 10:58:34+00:00

Hey Hugging Face Community,

I’ve engineered and open-sourced a Decay-Gated O(N) Causal Linear Attention architecture featuring fused Triton/CUDA state accumulation kernels designed to bypass quadratic MHA bottlenecks.

Key Specs & Benchmark Metrics:

Repository & Research Paper:

Would love to gather thoughts on integration into Hugging Face Transformers model classes or benchmark comparisons with existing linear models!