AI Glossary

Greedy decoding

What does “Greedy decoding” mean?

Greedy decoding: Choosing the single most probable next token at every step.

Greedy decoding visual guide: Choosing the single most probable next token at every step.
Visual guide Open full size (new tab)

What is an example of “Greedy decoding”?

A decoder always takes the highest-scoring continuation available at that moment.

Keep learning

See also

DecodingTermTemperatureTermTop-pTermTop-k samplingTermBeam searchTerm

Same topic

Best-of-N samplingTermGrouped-query attentionTermGPTTermLatent spaceTermGenerative adversarial networkTerm