Tag: DeiT
-
ViT vs DeiT Review: Pure Attention Meets Distillation
ViT vs DeiT: how distillation and data augmentation let DeiT match ViT accuracy without 300M pretraining images. Training logs and ablation results included.
ViT vs DeiT: how distillation and data augmentation let DeiT match ViT accuracy without 300M pretraining images. Training logs and ablation results included.