BCMT

Researchers introduced BCMT (Blockwise Causal Memory Transformer), a new architecture for long-context language modeling that decouples local token interactions from global context propagation, achiev…

A new research project called BCMT (Blockwise Causal Memory Transformer) proposes an alternative architecture for long-context language modeling that achieves O(TL) computational complexity compared t…