AI Glossary

Synthetic supervision

What does “Synthetic supervision” mean?

Synthetic supervision: Using generated answers, labels, or feedback as training supervision.

Synthetic supervision visual guide: Using generated answers, labels, or feedback as training supervision.
Visual guide Open full size (new tab)

What is an example of “Synthetic supervision”?

A stronger model produces worked examples for a smaller model to learn from.

Keep learning

See also

Fine-tuningTermInstruction tuningTermKnowledge distillationTermMasked language modelingTermNext-token predictionTerm

Same topic

Preference datasetTermTemporal difference learningTermSynthetic dataTermTransfer datasetTermStochastic gradient descentTerm