BCMT: Blockwise Causal Memory Transformer
Researchers introduced BCMT (Blockwise Causal Memory Transformer), a new architecture for long-context language modeling that decouples local token interactions from global context propagation, achieving validation perfo…