AI Glossary

Memory-bound workload

What does “Memory-bound workload” mean?

Memory-bound workload: A workload limited mainly by how quickly data can be accessed or moved.

Memory-bound workload visual guide: A workload limited mainly by how quickly data can be accessed or moved.
Visual guide Open full size (new tab)

What is an example of “Memory-bound workload”?

An inference step can wait on memory even when arithmetic units have spare capacity.

Keep learning

See also

GPUTermTPUTermNPUTermMemory bandwidthTermCompute-bound workloadTerm

Same topic

Matrix multiplicationTermTensor coreTermMixed-precision trainingTermModel compressionTermModel endpointTerm