Microsoft is rolling out several new AI features for Windows 11, including a Copilot Vision tool that can scan everything on your screen. These functionsCurrently being gradually rolled out to everyone, which also includes some tools unique to Copilot Plus PC.
Copilot Vision scans all the apps and web pages you have open on your screen.
First, all Windows 11 users can now access Copilot Vision through the Copilot app, which uses artificial intelligence to analyze what’s on the screen. Using this tool, you can ask aloud content from multiple apps and web pages that are open on your screen. You can also ask it how to accomplish specific tasks on your computer, such as how to improve the lighting in a photo. Microsoft first began testing a limited version of the feature last year.
In addition, users of Snapdragon Copilot Plus PCs can access the AI “agent” in the Settings app. You can use natural language to search for specific settings, such as "I want to enable silent time" or "Connect a Bluetooth device." If the agent is able to perform the task, it will offer to do it on your behalf.
Microsoft is also enhancing its AI-powered "Click to Do" preview feature on Copilot Plus PC. This feature appears when the user holds down the Windows key and left-clicks on an app, text, website, or other content, and is designed to help you quickly complete an action, such as summarizing a highlighted paragraph. As part of the update, Microsoft is rolling out several new features available through Click to Do, including using reading coaching tools to practice reading fluency and pronunciation, using Copilot to draft documents in Microsoft Word, and scheduling Teams meetings.
One-click actions let you quickly perform actions, such as summarizing text.
Other features available only on Copilot Plus PC include a new AI sticker generator in Paint, and an object selection tool in the app that lets you isolate and edit specific parts of an image. Additionally, Snapdragon-powered Copilot Plus PCs have new AI lighting options in the Photos app, as well as a Perfect Snip tool in Snipping Tool, which uses AI technology to "precisely capture what's on the screen."
Copilot Plus PC users will find a new AI object selection tool in their Paint toolbar.
Microsoft is also releasing some non-AI-related features across all Windows 11 PCs, including a handy color picker in the Snipping Tool and a new mechanism that allows PCs to automatically fix issues that cause unexpected reboots.
Microsoft says all these features will be rolling out "next month." Some of these features are already available in new non-security preview updates for Windows, which you can also download from the Microsoft Store.