AI Glossary
Training data
What does “Training data” mean?
Training data: The specific information a model learns from during training. For language models it is usually a very large mix of text, and sometimes code, images or audio. What is in it, and what is missing, determines much of what the model knows and the mistakes it makes.
What is an example of “Training data”?
A model whose training data ends at a certain point will not know about events after that date unless given extra information.