ML Katas

Implement Label Smoothing

medium (<30 mins) pytorch training label smoothing classification
this month by E

Write a function to apply label smoothing for classification:

  • Replace one-hot targets with 1ϵ for true class, ϵ/(K1) for others.
  • Use it in cross-entropy training.

Show improved generalization on toy data.