How to Choose Your Teacher for Fine Grained Image Recognition

A new arXiv paper proposes Ratio 1-2, a metric for selecting distillation teachers in fine-grained image recognition.

Across more than 1,000 experiments, it improved student accuracy with multiple teacher, student, dataset, and training combinations.

The approach offers a practical way to choose better teachers and boost compressed vision models on constrained devices.