ITNet: A Learnable Integral Transform That Subsumes Convolution, Attention, and Recurrence
Researchers introduced the Integral Transform Network (ITNet), a unified architecture that subsumes convolution, attention, and recurrence as special cases of a learnable integral transform. ITNet matβ¦