WindowsCopilot currently offers very few features, but that will change soon. Microsoft is adding a new feature that lets you, the user, take a screenshot and ask artificial intelligence to interpret it. The new feature, called "Add Screenshot," is rolling out to the public, but it won't necessarily be available to everyone.
With the new "Add Screenshot" button in the Copilot panel, you can take a screenshot and upload it directly to the Copilot or Bing panel. When a screenshot is uploaded to Copilot on Windows 11, you can ask Bing Chat to discuss the screenshot. You can ask any questions related to screenshots.
This is similar to the existing image upload functionality in copilot.microsoft.com or Bing.com chat tools, but is more suitable for screenshots when integrated. In the example below, we asked Copilot to explain a screenshot of the Recycle Bin, and it quickly provided a brief description:
This is an image of the recycle bin icon on your computer desktop. Recycle Bin is a feature of Windows operating system that allows users to temporarily store deleted files and folders before permanently deleting them.
Since Copilot supports Microsoft Edge, its screenshot feature also allows you to draw on the screenshot or add specific captions that Copilot can see.
If you have access to ChatGPT-4Turbo (rolling out to some users), you can ask WindowsCopilot to interpret emotions, including those depicted in abstract pictures. The feature is only available to a randomly selected group of users, but Microsoft plans to expand the rollout in the coming weeks.
Microsoft emphasizes that Copilot is a core feature of all products, including Office and Windows.
Later in 2024, Microsoft will add a dedicated Copilot button to Windows hardware to "simplify people's computing experience."
Microsoft wants Copilot to be everywhere. This shouldn’t be a secret to anyone, and we’ve highlighted this in previous coverage. In a blog post, Microsoft recently confirmed plans to add Copilot keys to Windows keyboards. On older hardware, you can access Copilot via the Win+C shortcut.
Microsoft is promoting the change as the most significant upgrade to the Windows keyboard in nearly three decades, comparing it to the introduction of the Windows Start key.
"Copilot will be the gateway to the world of artificial intelligence on the PC," Microsoft said, confirming that the new generation of hardware will be equipped with Copilot keys.