AI Glossary

Optimizer

Also called optimization algorithm

What does “Optimizer” mean?

Optimizer: The algorithm that updates parameters using information about the loss and its gradients.

Optimizer visual guide: The algorithm that updates parameters using information about the loss and its gradients.
Visual guide Open full size (new tab)

What is an example of “Optimizer”?

An Adam optimizer adjusts how much each parameter moves at every step.

Keep learning

See also

TrainingTermRegularizationTermLearning rateTermStochastic gradient descentTermAdam optimizerTerm

Same topic

OverfittingTermNext-token predictionTermOversamplingTermMomentum in optimizationTermParameter-efficient fine-tuningTerm