All Katas - ML Katas

by: newest upvotes saves

Tracing Gradient Descent on a Parabola

this year easy (<30 mins) | Gradient Descent Optimization Calculus

Imagine a simple 1D function $f(x) = x^2 - 4x + 5$. Your goal is to find the minimum of this function using Gradient Descent. 1. **Derive the gradient**: What is $\frac{df}{dx}$? 2. **Perform a...