Gradient Descent

The core optimization algorithm behind most model training: repeatedly nudge the model’s parameters in the direction that most reduces error, a small step at a time.