AI Glossary
Curriculum learning
What does “Curriculum learning” mean?
Curriculum learning: Presenting training data in a planned order instead of a purely random one, often easier examples before harder ones. In large-model training, the term also covers changing the mix of data sources between stages of a run.
What is an example of “Curriculum learning”?
Some pre-training recipes end with a final phase weighted toward high-quality sources such as curated text, math and code to sharpen the model's skills.