ImageNet-1K

Researchers propose LEAP, a training curriculum for Vision Transformer feature-based knowledge distillation that uses the teacher's intermediate feature maps as progressively difficult targets. LEAP a…

Researchers introduced the Integral Transform Network (ITNet), a unified architecture that subsumes convolution, attention, and recurrence as special cases of a learnable integral transform. ITNet mat…