04:00
2026-08-18
arxiv.org
large-language-models
Wiola 13M, a Gated Spiral Attention Architecture for Parameter Efficient Small Language Models
Researchers introduced Wiola, a decoder-only language model with three novel components—Spiral Rotary Positional Encoding, Gated Spiral Attention, and a Butterfly feed-forward block—designed for param…