Batch Normalization From Scratch
Implement 1D batch normalization manually (without using nn.BatchNorm1d
). Steps:
- Compute batch mean and variance.
- Normalize inputs.
- Scale and shift with learnable .
Compare with PyTorch's built-in BatchNorm1d
on random input.