ViT-S

Researchers propose CoDAT, a Collaborative Dual-Attention Transformer for efficient edge action recognition, which replaces multi-head attention with a lightweight dual-branch module and a parameter-f…

Researchers propose LEAP, a training curriculum for Vision Transformer feature-based knowledge distillation that uses the teacher's intermediate feature maps as progressively difficult targets. LEAP a…