Training, Reading, and Editing Legible Transformers
A new transformer architecture achieves 78% legibility in feed-forward operands and 50% in attention value channels by training operators to be crisp, bounded, and named as fuzzy set operations, researchers report in arX…