AI Glossary

On-device AI

Also called local AI

What does “On-device AI” mean?

On-device AI: The model runs directly on your own phone, laptop or other gadget instead of on a remote server. It can work offline and keeps data on the device, but it is limited by the device's memory, battery and chip, so on-device models are usually smaller.

On-device AI visual guide: The model runs directly on your own phone, laptop or other gadget instead of on a remote server. It can work offline and keeps data on the device, but it is limited by the device's memory, battery and chip, so on-device models are usually smaller.
Visual guide Open full size (new tab)

What is an example of “On-device AI”?

Phone makers increasingly run some assistant features locally and send only harder requests to the cloud.

Keep learning

See also

Edge AITermNPUTermQuantizationTermSmall language modelTerm

Same topic

Data privacyTermModel compressionTermONNXTermPower usage effectivenessTermModel servingTerm