14:10
2026-09-14
huggingface.co
artificial-intelligence
SAS: Simple Attention Sparsification via End-to-End Optimization of Context Ranking
Researchers introduced Simple Attention Sparsification (SAS), a gated sparse attention mechanism that optimizes context ranking end-to-end with the language modeling loss by injecting the selector's cā¦