AI Glossary

Compute

Also called training compute

What does “Compute” mean?

Compute: In AI, compute is the processing power used to train or run models, usually on GPUs or other specialized accelerators. Training compute is often measured as the total number of floating-point operations (FLOPs), and it is one of the biggest costs of building frontier models.

Compute visual guide: In AI, compute is the processing power used to train or run models, usually on GPUs or other specialized accelerators. Training compute is often measured as the total number of floating-point operations (FLOPs), and it is one of the biggest costs of building frontier models.
Visual guide Open full size (new tab)

What is an example of “Compute”?

Some AI regulations and company safety policies use training-compute thresholds to decide which models need extra testing or reporting.

Keep learning

See also

Scaling lawsTermGPUTermPre-trainingTermFLOPsTerm

Same topic

Curriculum learningTermCheckpointTermData labelingTermBatch sizeTermDirect preference optimizationTerm