AI Glossary

WordPiece

What does “WordPiece” mean?

WordPiece: A subword tokenization approach that learns a vocabulary of useful fragments.

WordPiece visual guide: A subword tokenization approach that learns a vocabulary of useful fragments.
Visual guide Open full size (new tab)

What is an example of “WordPiece”?

A model can split an unfamiliar word into familiar pieces instead of treating it as entirely unknown.

Keep learning

See also

TokenizerTermTokenTermEmbeddingsTermByte pair encodingTermSentencePieceTerm

Same topic

Special tokenTermVocabulary sizeTermVision-language modelTermVision transformerTermVerifier modelTerm