AI Glossary

Interconnect

What does “Interconnect” mean?

Interconnect: Chips in a cluster must constantly exchange data, and the interconnect is the high-speed wiring and networking that carries it. Slow links leave expensive processors waiting. Examples include Nvidia's NVLink between GPUs, and InfiniBand or specialized Ethernet between servers.

Interconnect visual guide: Chips in a cluster must constantly exchange data, and the interconnect is the high-speed wiring and networking that carries it. Slow links leave expensive processors waiting. Examples include Nvidia's NVLink between GPUs, and InfiniBand or specialized Ethernet between servers.
Visual guide Open full size (new tab)

What is an example of “Interconnect”?

Adding more GPUs only speeds up training if the interconnect can keep them all supplied with data.

Keep learning

See also

Compute clusterTermGPUTermData centerTermHigh-bandwidth memoryTerm

Same topic

Model compressionTermInference serverTermModel servingTermHyperscalerTermNPUTerm