AI Glossary

Constrained decoding

What does “Constrained decoding” mean?

Constrained decoding: Limiting which tokens may be generated to enforce rules such as a grammar or schema.

Constrained decoding visual guide: Limiting which tokens may be generated to enforce rules such as a grammar or schema.
Visual guide Open full size (new tab)

What is an example of “Constrained decoding”?

A decoder masks tokens that would make a response invalid JSON.

Keep learning

See also

PromptTermPrompt engineeringTermContext engineeringTermOutput parsingTermSchema validationTerm

Same topic

Stop sequenceTermContext windowTermChunkingTermContextual retrievalTermChain of thoughtTerm