AI Glossary

Log probability

Also called logprob, log probability score

What does “Log probability” mean?

Log probability: The logarithm of a probability, commonly used to represent token scores.

Log probability visual guide: The logarithm of a probability, commonly used to represent token scores.
Visual guide Open full size (new tab)

What is an example of “Log probability”?

A decoder adds token log probabilities to score an entire proposed sequence.

Keep learning

See also

TokenizerTermTokenTermEmbeddingsTermVocabulary sizeTermToken probabilityTerm

Same topic

Long short-term memoryTermLatent spaceTermMixture of expertsTermGrouped-query attentionTermMulti-head attentionTerm