AI Glossary

Computer use

What does “Computer use” mean?

Computer use: Ability of a model to operate a computer the way a person does: viewing screenshots, then moving the mouse, clicking and typing. It works with apps that have no API, but tends to be slower and more error-prone than direct tool calls.

Computer use visual guide: Ability of a model to operate a computer the way a person does: viewing screenshots, then moving the mouse, clicking and typing. It works with apps that have no API, but tends to be slower and more error-prone than direct tool calls.
Visual guide Open full size (new tab)

What is an example of “Computer use”?

Computer use can fill in an old desktop accounting program that offers no way to connect except its on-screen forms.

Keep learning

See also

Browser agentTermAI agentTermSandboxTermPrompt injectionTerm

Same topic

Vision-language modelTermContext engineeringTermCoding agentTermCopilotTermHandoffTerm