AI Glossary

Model gateway

What does “Model gateway” mean?

Model gateway: A service that routes model calls and can apply authentication, limits, or logging.

Model gateway visual guide: A service that routes model calls and can apply authentication, limits, or logging.
Visual guide Open full size (new tab)

What is an example of “Model gateway”?

A company sends requests through a gateway that picks a provider by policy.

Keep learning

See also

Model servingTermInference serverTermModel compressionTermModel endpointTermModel fallbackTerm

Same topic

Inference queueTermModel registryTermModel shardingTermNPUTermMixed-precision trainingTerm