Show HN: Bypassing Transformer Softmax via Static Contraction
A Proof-of-Concept repository published on GitHub under the project jax-softmax-bypass claims to bypass the Transformer Softmax's transcendental exponential function through a static algebraic contrac…