All Katas - ML Katas

by: newest upvotes saves

Implementing Layer Normalization from Scratch

this month medium (<30 mins) | training custom module normalization layer

Implement **Layer Normalization** as a custom `torch.nn.Module`. Unlike `BatchNorm`, `LayerNorm` normalizes across the features of a single sample, not a batch. Your implementation should...