Microsoft is expanding the capabilities of its Copilot Vision AI tool, allowing it to analyze everything displayed on a user's screen. This update, currently available to Windows Insiders,…
Microsoft is expanding the capabilities of its Copilot Vision AI tool, allowing it to analyze everything displayed on a user's screen. This update, currently available to Windows Insiders, marks a significant advancement from the previous version, which could only analyze two apps at a time.
The new Copilot Vision can now scan the entire desktop or any specific browser or app window, providing a comprehensive view of the user's digital environment. The functionality of Copilot Vision is designed to offer users insights and assistance based on what it sees. By clicking the glasses icon in the Copilot app and selecting the desired screen area, users can activate the feature.
Microsoft explains that Copilot Vision can "help analyze content, provide insights, and answer your questions, coaching you through it aloud." This includes offering advice on creative projects, improving resumes, or providing guidance while playing games. Copilot Vision's evolution began last year with its ability to analyze web content in Microsoft Edge.
Furthermore, the tool can already interpret images captured by a user's mobile phone camera, answering questions about the visual content. This latest update demonstrates Microsoft's commitment to enhancing AI-powered tools, offering users more comprehensive and integrated assistance within their digital workspaces.