Making Knowledge Distillation Cheap Enough to Run at Scale

Details in article.

Source: Hugging Face