ML Katas

by: newest upvotes saves

L2 Regularization's Gradient Impact

this year medium (<1 hr) | Regularization Overfitting L2 Norm

L2 regularization (also known as weight decay) is a common technique to prevent overfitting. 1. **Loss Function**: Consider a simple linear regression loss with L2 regularization: $J(\mathbf{w},...

1