AI Glossary
Asynchronous inference
What does “Asynchronous inference” mean?
Asynchronous inference: Requesting model work and receiving its result later without holding the original call open.
What is an example of “Asynchronous inference”?
An image application submits a job and checks back when it is ready.