Microsoft Copilot Vision transforms your phone's camera into an interactive visual search instrument.

      Late last year, Microsoft launched a new AI feature named Copilot Vision for the web, which is now being extended to mobile devices. This feature works with your phone’s camera to create interactive real-world experiences, allowing it to analyze live video and photos saved on your device.

      On mobile, Copilot Vision improves functionality by enabling the AI assistant to “see” and interpret different content. Whether you are shopping, reading, or researching, Copilot can offer additional information and assist you in completing tasks more effectively.

      To use Copilot Vision on a mobile device, simply launch the Copilot app, access your camera, and observe your surroundings. Copilot will provide context and explanations regarding the items you see. Microsoft has shared various use cases, such as evaluating plant health or providing home decor suggestions.

      Are you worried about security? Copilot will only access your phone's camera for Vision if you grant permission, otherwise it will not.

      Currently, Copilot Vision is available in the Voice mode of the Copilot app and is open to Copilot Pro subscribers in the U.S., with plans to reach more users in the future.

      This feature is part of Microsoft’s broader initiative to create a more cohesive AI assistant experience across devices. Microsoft asserts that these enhancements make Copilot a more personalized, interactive, and user-friendly component of everyday life.

      Microsoft Copilot Pro is priced at $20 per month. It offers subscribers preferential access to advanced AI models during peak times, higher usage limits, and early access to experimental features.

      On February 7, 2023, Microsoft launched “Bing Chat” as part of a major overhaul of Bing. This chatbot feature, developed by Microsoft, was integrated into both Bing and the Edge browser, representing an evolution of the Cortana chatbot, utilizing OpenAI’s technology.

      In March of that year, Microsoft rolled out Microsoft 365 Copilot, aimed at Microsoft 365 applications and services. Its marketing primarily focused on boosting business productivity as an additional feature of Microsoft 365. This version merged the capabilities of large language models with data from Microsoft Graph and Microsoft 365 apps, intending to "transform your words into the most powerful productivity tool on the planet."

      In March 2024, Microsoft introduced its first major upgrade by adding support for GPT-4 Turbo. Later, in September 2024, the company announced several key updates as part of the rollout of “Copilot Wave 2,” including the adoption of OpenAI's GPT-4o model. These enhancements continue to broaden Copilot's functionality across Microsoft's ecosystem.