AI Glossary

AI energy use

Also called power consumption

What does “AI energy use” mean?

AI energy use: Training and running AI models consumes significant electricity, mostly to power accelerators and the cooling that keeps them working. Usage depends on model size, hardware efficiency and how many requests are served. Reliable per-query figures are hard to pin down and vary widely by system.

AI energy use visual guide: Training and running AI models consumes significant electricity, mostly to power accelerators and the cooling that keeps them working. Usage depends on model size, hardware efficiency and how many requests are served. Reliable per-query figures are hard to pin down and vary widely by system.
Visual guide Open full size (new tab)

What is an example of “AI energy use”?

Access to power has become a key constraint on where and how fast new AI data centers can be built.

Keep learning

See also

Data centerTermPower usage effectivenessTermData center coolingTermInferenceTerm

Same topic

BatchingTermAI acceleratorTermCapexTermCloud AITermCompute clusterTerm