DeiT-S

Researchers introduced HetDPT, a depth pruning method for Vision Transformers that speeds up DeiT-B by 1.58x and DeiT-S by 1.39x with minimal accuracy loss, and combined with width pruning (HetDPT+) a…

A new study comparing Vision Transformers and CNNs for face presentation attack detection found that pretrained Vision Transformers reduce demographic bias and improve accuracy. The DeiT-S model achie…