Discriminative Fine-Tuning: Why Your Backbone and Your Head Shouldn't Learn at the Same Speed
A developer fine-tuning DEIMv2, a DETR-style detector with a DINOv3 Vision Transformer backbone, applied discriminative fine-tuning — assigning the backbone a learning rate of 5e-6 and the decoder head 1e-4, a 20x gap — …