Revolutionizing Long-Context Transformers with Hierarchical Global Attention
Researchers introduced Hierarchical Global Attention (HGA), a method that reduces GPU memory usage in long-context transformers by using hierarchical routing, enabling a 64K-token context on an RTX 5090 GPU with 32GB mem…