“Click To Do” is Windows 11’s answer to Android’s “Circle To Search” — an AI overlay that understands what’s on screen and helps complete actions

"Click To Do" is Windows 11's answer to Android's "Circle To Search" — an AI overlay that understands what's on screen and helps complete actions

What you need to know

  • Microsoft is launching a new AI screen analyzer on Windows 11 later this year called Click To Do.
  • Click To Do works similarly to Android’s Circle To Search, allowing users to quickly search the web based on an element selected on screen.
  • Click To Do goes a step further with contextual actions based on what’s currently on screen. 
  • Click To Do is exclusive to Copilot+ PCs.

As a seasoned researcher who has witnessed the evolution of technology over the past few decades, I must say that Microsoft’s announcement of Click To Do on Windows 11 is nothing short of intriguing. Having dabbled with Android devices and their Circle To Search functionality, it’s exciting to see a more advanced version emerging from the Redmond giant.


This year, Microsoft is set to launch a significant AI enhancement for Copilot+ computers only, featuring an intelligent interface layer that seamlessly integrates with the operating system. This interface has the ability to comprehend the content displayed on the screen and offer contextually relevant actions at any moment. To activate this layer, simply hold down the Windows key while clicking your mouse.

The feature is called Click To Do and is a clear competitor to Android’s Circle To Search function, only more capable. In addition to providing a quick way to visually search the web, Click To Do also provides contextual suggestions based on what it can see on screen. 

For example, if you’ve selected some text, Click To Do will offer actions such as summarizing what’s been highlighted or rewriting it. If you’ve selected an image, Click To Do will provide quick actions like blurring the background or erasing an object within the image that has been selected.

In the Click To Do overlay, you can easily find items displayed on your screen using a floating search bar conveniently located at the top. This interface is designed for easy navigation, providing quick access to Windows Recall as both tools employ similar tech for recognizing screen content.

Due to its requirements, the Click To Do feature will only be available for Copilot+ PCs that have a Neural Processing Unit (NPU) capable of 40 Tera Operations Per Second (TOPS) or more, starting later this year. If you’re not using a Copilot+ PC, unfortunately, you won’t be able to access this feature when it becomes available. The testing phase for Click To Do on Copilot+ PCs will commence in October, with the rollout planned to start from November and continue in waves thereafter.

The “Click To Do” function demonstrates AI being beneficial in terms of boosting productivity. It’s a feature created to simplify tasks and enhance user experiences by suggesting contextual actions believed to be most relevant, considering what’s displayed on the screen at the moment. When it comes to AI, its role as a productivity tool is undeniably the most advantageous form.

This autumn, Microsoft is set to introduce several additional AI capabilities for Copilot+ PCs. One of these features involves integrating AI into Windows Search for a more seamless user experience. Additionally, a revamped, more engaging Copilot experience is being rolled out today. This enhanced version allows the system to browse the web concurrently with you and assist with tasks using Copilot Vision technology.

Read More

2024-10-01 17:11