Let's Stop Calling Everything "Linear Attention"
A new critique argues that the term 'linear attention' is overused and ambiguous, covering at least six different resource claims that range from constant computation per token to merely reduced KV cache size. The piece,…