AI Glossary

Token probability

What does “Token probability” mean?

Token probability: A model's estimated probability for a token under a given context.

Token probability visual guide: A model's estimated probability for a token under a given context.
Visual guide Open full size (new tab)

What is an example of “Token probability”?

A next-token model assigns different probabilities to several possible continuations.

Keep learning

See also

TokenizerTermTokenTermEmbeddingsTermEnd-of-sequence tokenTermVocabulary sizeTerm

Same topic

Log probabilityTermTop-k samplingTermTest-time computeTermTransformerTermState-space modelTerm