Transolver, UPT, AB-UPT: Making Global Attention Affordable
Transolver, UPT, and AB-UPT each replace full point-to-point self-attention with smaller token sets to make global computation affordable on industrial-scale meshes, according to Part 5 of the Geometric Deep Learning ser…