All Katas - ML Katas

by: newest upvotes saves

Custom `nn.Module` with a Non-standard Initialization

this month medium (<10 mins) | initialization custom module weights bias

Create a **custom `nn.Module`** for a simple feed-forward layer. Instead of the default PyTorch initialization, you'll apply a specific, non-standard initialization scheme. For example, you could...
Implementing a Simple Attention Mechanism

this month medium (<1 hr) | rnn attention mechanism seq2seq weights

Implement a **simple attention mechanism** for a sequence-to-sequence model. Given a sequence of encoder outputs and a single decoder hidden state, your attention module should compute attention...