ML Katas

Weight Initialization Techniques

medium (<30 mins) pytorch deep learning training initialization
this month by E

Initialize a neural network's weights using different schemes:

  • Xavier initialization.
  • Kaiming initialization.

Show histograms of weight distributions before and after initialization.