Microsoft's Copilot Vision AI is now available for free, but only on these 9 websites.

Microsoft's Copilot Vision AI is now available for free, but only on these 9 websites.

      Digital Trends might receive a commission if you purchase through links on our site. Why should you trust us?

      After several months of teasers, previews, and selective rollouts, Microsoft’s Copilot Vision is now available for all Edge users in the U.S. This new AI tool is designed to observe your screen while you browse, allowing you to ask it various questions about your activities and receive contextually relevant responses. However, the main limitation is that it currently works with only nine specific websites.

      These nine websites appear to be a somewhat arbitrary selection. Amazon is a logical choice, but Geoguessr seems peculiar since the objective of that site is to determine your location on a map without assistance. The complete list of supported sites is as follows:

      Microsoft

      Wikipedia

      Tripadvisor

      Williams Sonoma

      Amazon

      Target

      Wayfair

      Food & Wine

      OpenTable

      Geoguessr

      Microsoft AI CEO Mustafa Suleyman announced the release on Bluesky yesterday and shared a few of his favorite applications.

      Normally, when you want to ask Copilot a question, you have to provide the context in writing, which can be both slow and frustrating, especially if you’re inquiring about something you're not well-versed in.

      With Copilot Vision, rather than trying to explain what you're seeing or discussing, the AI model can directly view your screen.

      As per Suleyman’s examples, you might search for “breathable sheets” on Amazon and ask Copilot whether any of the options are made from suitable fabrics. Copilot can highlight the correct items or provide examples of breathable materials for you to look for.

      On the Food & Wine recipe site, Copilot can assist you hands-free while cooking by answering questions and reading portions of the recipe aloud to you. This feature is designed for voice interaction—you speak to the AI, and it responds.

      However, one of the videos on the Copilot Vision page indicates that you can also type your questions and receive written answers.

      Microsoft is proceeding cautiously with this feature, likely to avoid a negative reaction akin to what it encountered with Recall. The limited number of compatible sites is related to copyright considerations, and the company emphasizes that the feature is “opt-in,” does not record your screen, operates only when activated, and deletes data immediately after a session ends.

      If you’d like to try it out, you can set it up and view a short tutorial on the Microsoft website.

      Willow Roberts has been a Computing Writer at Digital Trends for one year and has been writing for about a decade.

      Recently, Microsoft’s Bing introduced a Copilot Search mode in competition with Google's AI Search. Just weeks ago, Google launched a new AI Search mode designed to deliver answers as block text, similar to responses from an AI chatbot, as opposed to the standard Search Results with blue links leading to different sources. Microsoft has now entered the fray as well, quietly rolling out a new Copilot Search feature for its Bing search engine. This feature was first identified by Windows Latest, but Digital Trends has confirmed that it is now available across all platforms.

      If you were excited about the promise of an AI-enabled Copilot+ PC featuring the latest Intel or AMD processors, and found some functionalities missing, your wait is finally over. A number of those Copilot+ features are now being made available beyond devices equipped with a Snapdragon X series processor. It has been nearly a year since Microsoft announced the Copilot+ PC label, a new class of computing machines emphasizing AI performance. For several months, Qualcomm was the exclusive silicon supplier for these devices.

      Additionally, Microsoft is finally introducing a sophisticated research tool to the Microsoft 365 Copilot platform across web, mobile, and desktop, albeit a bit late to the party. Unlike competing products such as Google Gemini, Perplexity, or OpenAI’s ChatGPT— all of which utilize the Deep Research designation— Microsoft has opted to call its feature the Researcher agent.

      The fundamental concept remains similar: you instruct the Copilot AI to generate thoroughly researched material on a specific subject or create an action plan, and it will produce a detailed document that would typically require hours of human research and compilation. It aims to perform complex, multi-step research on your behalf as an autonomous AI agent.

      To clarify, Microsoft 365 Copilot is essentially the rebranded version of the previous Microsoft 365 (Office) app and is distinct from the standalone Copilot app, which serves more as a general-purpose AI chatbot.

      Regarding how the Researcher agent operates, it's underpinned by OpenAI's Deep Research model. However, this is not just a straightforward duplication. The implementation of this feature within Microsoft 365 Copilot runs much deeper than that of its competitors. This depth arises from its ability to analyze your own content, or a company’s internal data, as well.

      Rather than relying solely on internet information, the Researcher agent can also examine internal documents such as emails, chats, meeting logs, calendars

Microsoft's Copilot Vision AI is now available for free, but only on these 9 websites. Microsoft's Copilot Vision AI is now available for free, but only on these 9 websites. Microsoft's Copilot Vision AI is now available for free, but only on these 9 websites. Microsoft's Copilot Vision AI is now available for free, but only on these 9 websites. Microsoft's Copilot Vision AI is now available for free, but only on these 9 websites. Microsoft's Copilot Vision AI is now available for free, but only on these 9 websites. Microsoft's Copilot Vision AI is now available for free, but only on these 9 websites.

Other articles

Microsoft's Copilot Vision AI is now available for free, but only on these 9 websites.

Microsoft's Copilot AI is now capable of observing your screen while you browse, allowing you to ask it questions regarding your activities.