
Vision-language model
Takes images and text together, so it can describe pictures, read documents and answer questions about what it sees.
Every major kind of AI model in plain English: what it does, how it works, when to use it, and open-source repos to try.
3 model types in Vision · Show all

Takes images and text together, so it can describe pictures, read documents and answer questions about what it sees.

Recognizes what is in an image by treating it as a grid of patches, the backbone of modern computer vision.

Finds where things are in an image, drawing boxes or exact outlines around each object.
Each page explains what the model type does, how it works, what it is good and bad at, and links to open-source GitHub repositories you can try. For single terms, see the AI Glossary.