AI Glossary

Compute cluster

Also called cluster

What does “Compute cluster” mean?

Compute cluster: Many servers linked by fast networking can be made to work as one large system, called a cluster. Training a frontier model requires splitting the work across thousands of accelerators in a cluster, all coordinating closely over many weeks or months.

Compute cluster visual guide: Many servers linked by fast networking can be made to work as one large system, called a cluster. Training a frontier model requires splitting the work across thousands of accelerators in a cluster, all coordinating closely over many weeks or months.
Visual guide Open full size (new tab)

What is an example of “Compute cluster”?

When AI labs talk about a new training run, they often describe it by the size of the cluster it used.

Keep learning

See also

Data centerTermInterconnectTermGPUTermFLOPsTerm

Same topic

CUDATermCloud AITermCapexTermData center coolingTermBatchingTerm