DecodeAI
Gradient Descent — Topic Deep Dive
Free

Optimizers in Practice

From SGD to AdamW with schedules that work.

Gradient descent variants

18 minvideo

Optimizers in Practice lab notes

25 minreading

Work through a short applied exercise for Optimizers in Practice. Write assumptions, run a minimal experiment, and note what broke.