AI Glossary
Learning rate schedule
What does “Learning rate schedule” mean?
Learning rate schedule: A rule for changing the learning rate during training.
What is an example of “Learning rate schedule”?
A run starts with a short warmup and gradually lowers its learning rate.