AI Glossary
Autoregressive model
What does “Autoregressive model” mean?
Autoregressive model: Autoregressive models generate output one piece at a time, with each new piece predicted from everything produced before it. Most text-generating language models work this way, which is why responses appear word by word and why early mistakes can carry forward.
What is an example of “Autoregressive model”?
When a chatbot streams its answer onto your screen, you are watching autoregressive generation: each token is chosen, appended, and then used to predict the next.