All Katas - ML Katas

by: newest upvotes saves

Implementing a Custom Learning Rate Scheduler

this month medium (<1 hr) | training custom scheduler learning rate

Implement a **custom learning rate scheduler** that follows a cosine annealing schedule. The learning rate starts high and decreases smoothly to a minimum value, then resets and repeats. Your...