Microsoft's Copilot Vision AI is now available for free, but only on these 9 websites.

Microsoft's Copilot Vision AI is now available for free, but only on these 9 websites.

      Digital Trends might receive a commission if you purchase through links on our site. Why should you trust us?

      After several months of teasers, previews, and selective rollouts, Microsoft’s Copilot Vision is now available for all Edge users in the U.S. This new AI tool is designed to observe your screen while you browse, allowing you to ask it various questions about your activities and receive contextually relevant responses. However, the main limitation is that it currently works with only nine specific websites.

      These nine websites appear to be a somewhat arbitrary selection. Amazon is a logical choice, but Geoguessr seems peculiar since the objective of that site is to determine your location on a map without assistance. The complete list of supported sites is as follows:

      Microsoft

      Wikipedia

      Tripadvisor

      Williams Sonoma

      Amazon

      Target

      Wayfair

      Food & Wine

      OpenTable

      Geoguessr

      Microsoft AI CEO Mustafa Suleyman announced the release on Bluesky yesterday and shared a few of his favorite applications.

      Normally, when you want to ask Copilot a question, you have to provide the context in writing, which can be both slow and frustrating, especially if you’re inquiring about something you're not well-versed in.

      With Copilot Vision, rather than trying to explain what you're seeing or discussing, the AI model can directly view your screen.

      As per Suleyman’s examples, you might search for “breathable sheets” on Amazon and ask Copilot whether any of the options are made from suitable fabrics. Copilot can highlight the correct items or provide examples of breathable materials for you to look for.

      On the Food & Wine recipe site, Copilot can assist you hands-free while cooking by answering questions and reading portions of the recipe aloud to you. This feature is designed for voice interaction—you speak to the AI, and it responds.

      However, one of the videos on the Copilot Vision page indicates that you can also type your questions and receive written answers.

      Microsoft is proceeding cautiously with this feature, likely to avoid a negative reaction akin to what it encountered with Recall. The limited number of compatible sites is related to copyright considerations, and the company emphasizes that the feature is “opt-in,” does not record your screen, operates only when activated, and deletes data immediately after a session ends.

      If you’d like to try it out, you can set it up and view a short tutorial on the Microsoft website.

      Willow Roberts has been a Computing Writer at Digital Trends for one year and has been writing for about a decade.

      Recently, Microsoft’s Bing introduced a Copilot Search mode in competition with Google's AI Search. Just weeks ago, Google launched a new AI Search mode designed to deliver answers as block text, similar to responses from an AI chatbot, as opposed to the standard Search Results with blue links leading to different sources. Microsoft has now entered the fray as well, quietly rolling out a new Copilot Search feature for its Bing search engine. This feature was first identified by Windows Latest, but Digital Trends has confirmed that it is now available across all platforms.

      If you were excited about the promise of an AI-enabled Copilot+ PC featuring the latest Intel or AMD processors, and found some functionalities missing, your wait is finally over. A number of those Copilot+ features are now being made available beyond devices equipped with a Snapdragon X series processor. It has been nearly a year since Microsoft announced the Copilot+ PC label, a new class of computing machines emphasizing AI performance. For several months, Qualcomm was the exclusive silicon supplier for these devices.

      Additionally, Microsoft is finally introducing a sophisticated research tool to the Microsoft 365 Copilot platform across web, mobile, and desktop, albeit a bit late to the party. Unlike competing products such as Google Gemini, Perplexity, or OpenAI’s ChatGPT— all of which utilize the Deep Research designation— Microsoft has opted to call its feature the Researcher agent.

      The fundamental concept remains similar: you instruct the Copilot AI to generate thoroughly researched material on a specific subject or create an action plan, and it will produce a detailed document that would typically require hours of human research and compilation. It aims to perform complex, multi-step research on your behalf as an autonomous AI agent.

      To clarify, Microsoft 365 Copilot is essentially the rebranded version of the previous Microsoft 365 (Office) app and is distinct from the standalone Copilot app, which serves more as a general-purpose AI chatbot.

      Regarding how the Researcher agent operates, it's underpinned by OpenAI's Deep Research model. However, this is not just a straightforward duplication. The implementation of this feature within Microsoft 365 Copilot runs much deeper than that of its competitors. This depth arises from its ability to analyze your own content, or a company’s internal data, as well.

      Rather than relying solely on internet information, the Researcher agent can also examine internal documents such as emails, chats, meeting logs, calendars

Microsoft's Copilot Vision AI is now available for free, but only on these 9 websites. Microsoft's Copilot Vision AI is now available for free, but only on these 9 websites. Microsoft's Copilot Vision AI is now available for free, but only on these 9 websites. Microsoft's Copilot Vision AI is now available for free, but only on these 9 websites. Microsoft's Copilot Vision AI is now available for free, but only on these 9 websites. Microsoft's Copilot Vision AI is now available for free, but only on these 9 websites. Microsoft's Copilot Vision AI is now available for free, but only on these 9 websites.

Other articles

The most intriguing feature of Gemini is now available for free to all Android users. The most intriguing feature of Gemini is now available for free to all Android users. Google has announced that the impressive Gemini screen sharing and camera functionality will be accessible to all Android users. As AI inundates music platforms, Deezer is taking a stand — in contrast to Spotify. As AI inundates music platforms, Deezer is taking a stand — in contrast to Spotify. Deezer has provided an update regarding its initiatives to eliminate AI-generated music, distinguishing the French platform from the streaming leader Spotify. Mercury: superior to a bank, it's the financial operating system for your startup. Mercury: superior to a bank, it's the financial operating system for your startup. Inquire with any entrepreneur, and they'll affirm that banking is just the tip of the iceberg when it comes to startup finance. The real priorities are maintaining cash flow, securing funding at crucial moments, and avoiding being overwhelmed by administrative tasks. Mercury understands this well. It was specifically designed for these challenges. Instead of being just another SaaS solution with an attractive user interface […] ChatGPT now understands images more effectively than both an art critic and an investigator together. ChatGPT now understands images more effectively than both an art critic and an investigator together. The recent image generation features of ChatGPT have posed a challenge to our earlier perceptions of AI-produced media. The newly unveiled GPT-4o model showcases impressive skills in accurately interpreting images and recreating them with viral appeal, reminiscent of styles like those from Studio Ghibli. It has also excelled in handling text within AI-generated images, a task that has been challenging for AI in the past. And [...] Startup competition aims to find sustainable solutions for AI's energy requirements. Startup competition aims to find sustainable solutions for AI's energy requirements. The Energy Innovation for AI Startup Challenge will wrap up with a live pitch competition at the TNW Conference on June 19. Could this exoplanet be 'full of life'? Clues of life beyond our solar system. Could this exoplanet be 'full of life'? Clues of life beyond our solar system. A fascinating discovery suggests the potential for life beyond our solar system.

Microsoft's Copilot Vision AI is now available for free, but only on these 9 websites.

Microsoft's Copilot AI is now capable of observing your screen while you browse, allowing you to ask it questions regarding your activities.