04:00
2026-08-21
arxiv.org
artificial-intelligence
Asymmetric Attention Heads: Structured Head-Wise Context Allocation for Transformer Attention
A new arXiv paper (2608.19203v1) introduces Asymmetric Attention Heads (AAH), a framework that assigns different context window lengths to different attention heads in transformers, rather than givingβ¦