AI Glossary
Special token
What does “Special token” mean?
Special token: A reserved token used to convey structure rather than ordinary text.
What is an example of “Special token”?
A model uses a special token to mark the end of a sequence.
AI Glossary
Special token: A reserved token used to convey structure rather than ordinary text.
A model uses a special token to mark the end of a sequence.