Windows 11 is getting a flurry of powerful new AI features designed exclusively for Copilot+ PCs — here’s what’s coming

Windows 11 is getting a flurry of powerful new AI features designed exclusively for Copilot+ PCs — here's what's coming

What you need to know

  • Microsoft has taken the wraps off a new wave of AI features designed exclusively for Copilot+ PCs with Windows 11.
  • The new features include Windows’ own “Circle To Search” tool, image upscaling in Photos, and generative capabilities in Paint.
  • Microsoft is also bringing AI to Windows Search, which will let users search for files and images just by describing them. 

As an analyst with over two decades of experience in the tech industry, I’ve witnessed the evolution of AI from a distant dream to a reality that’s rapidly transforming our digital world. Microsoft’s latest move to integrate AI features exclusively for Copilot+ PCs with Windows 11 is nothing short of breathtaking.


In just under half a year since Copilot+ PCs were launched, Microsoft is preparing to release a fresh batch of AI capabilities specifically tailored for these AI-enabled devices. Introduced today, Windows 11 will receive four robust AI features that will only operate on Copilot+ PCs. Here’s an overview of the new additions:

  • Click To Do: An AI overlay that can analyze what’s currently on screen and offer contextual actions based on what’s selected
  • AI in Windows Search: Microsoft is adding descriptive language to search on Windows 11 in the File Explorer, Settings, and universal Windows Search pane.
  • Super Resolution in Photos: You will soon be able to upscale images using AI in the Photos app, powered by the on-device NPU.
  • Generative Fill/Erase in Paint: Adding or removing objects from images using AI in Paint is coming to Windows 11.

As a tech enthusiast, I’ve recently discovered an amazing new tool called Click To Do. It’s an AI overlay that’s always at your fingertips – just hold down the Windows key and give it a mouse click! The overlay pops up, providing contextual actions based on whatever’s currently displayed on your screen.

Windows 11 is getting a flurry of powerful new AI features designed exclusively for Copilot+ PCs — here's what's coming

Instead of just being a web search tool like Circle To Search on Android, this tool goes further by offering capabilities beyond simple online searching. For instance, when you select an image, Click To Do can identify it and present options relevant to the context, such as adjusting the background blur or erasing specific objects directly from the overlay’s menu. This demonstrates how artificial intelligence is effectively utilized for increasing productivity.

Besides Click To Do, Microsoft has also disclosed plans to incorporate AI into Windows Search to enhance its less-than-stellar search functionality. On Copilot+ PCs, the search feature in Windows will soon become more descriptive, allowing users to simply explain what document or image they’re seeking and have Windows locate it for them. This means you won’t have to recall specific file titles stored on your computer anymore.

Windows 11 is getting a flurry of powerful new AI features designed exclusively for Copilot+ PCs — here's what's coming

As an observer, I’m excited to share that this innovative AI-driven search functionality is debuting primarily within the File Explorer initially. Commonly used for locating documents and images, it’s anticipated that it will expand to encompass the main Windows Search interface and Settings in the upcoming months as well. This impressive new feature, if implemented effectively, could potentially address the issues with Windows 11’s current search system, which often fails to efficiently locate files when needed.

Microsoft is enhancing Paint and Photos applications by adding super-resolution and generative fill & erase features. Specifically, the Photos application will now support super-resolution technology, allowing users to enlarge images using the NPU on Copilot+ computers directly within the app. This enhancement enables images to be upscaled up to 8 times their original size in just a few seconds.

Windows 11 is getting a flurry of powerful new AI features designed exclusively for Copilot+ PCs — here's what's coming

In Paint, you’ll be able to fill or erase parts of an image using generative AI. The app now has an adjustable brush which gives more precision over particular areas you want to edit with AI, whether that be to remove objects or add objects using descriptive language. This is very similar to Magic Eraser on Android, now built directly into the Windows Paint app and runs locally.

Over the upcoming holiday season, Microsoft plans to grant access to these newly introduced features on Copilot+ PCs. Additionally, they have unveiled a completely revamped Copilot which is now available, boasting fresh abilities and interactions that strive to be more natural and user-friendly.

Read More

2024-10-01 17:20