All Katas - ML Katas

by: newest upvotes saves

Implement a Knowledge Distillation Loss

yesterday medium (<30 mins) | pytorch compression distillation

### Description Knowledge Distillation is a model compression technique where a small "student" model is trained to mimic a larger, pre-trained "teacher" model. [1] This is achieved by training...