AI Glossary

Soft prompt tuning

What does “Soft prompt tuning” mean?

Soft prompt tuning: Learning continuous input vectors that steer a frozen model.

Soft prompt tuning visual guide: Learning continuous input vectors that steer a frozen model.
Visual guide Open full size (new tab)

What is an example of “Soft prompt tuning”?

A classification system trains a short learned prefix while leaving model weights fixed.

Keep learning

See also

Fine-tuningTermInstruction tuningTermKnowledge distillationTermParameter-efficient fine-tuningTermAdapter layerTerm

Same topic

Contrastive learningTermMasked language modelingTermStochastic gradient descentTermScaling lawsTermSynthetic dataTerm