Since we first announced the new consumer Copilot in October, we’ve enjoyed seeing how people have made Copilot their own. It has helped people think through their ideas and gain a new perspective, made it less overwhelming to find the right information, and has even helped people feel supported in navigating difficult situations

Since we first announced the new consumer Copilot in October, we’ve enjoyed seeing how people have made Copilot their own. It has helped people think through their ideas and gain a new perspective, made it less overwhelming to find the right information, and even helped people feel supported as they navigate difficult conversations. Over the past few weeks, we’ve been taking feedback from our users and working to further improve the speed, simplicity, and personality of Copilot and its voice to make it a more helpful AI companion.

With this goal in mind, starting today, we’re introducing an experience where Copilot can now – with your permission – understand the full context of your online activity. When you activate Copilot Vision, it sees the page you are on, reads along, and you can talk together about the problem you are facing. Browsing no longer has to be a lonely experience with just you and all your tabs. We’re taking the first step toward making this a reality by launching Copilot Vision in preview to a limited number of Pro subscribers through Copilot Labs.

Vision is the first AI experience of its kind available only on Microsoft Edge. It’s a new way to invite AI to accompany you as you navigate the internet, conveniently hidden at the bottom of your Edge browser whenever you want to ask for help. It’s almost like having a second pair of eyes while surfing. Simply turn on Copilot Vision to instantly scan, analyze and provide insights based on what it sees.

For example, imagine it helping you plan a fun day at a museum and pointing out all the information you need to know before your visit.

Or perhaps Vision could help you with your holiday shopping by alerting you to which products you see on a page that match your needs and preferences.

Vision could even simplify information and learning. Watch Vision helps us learn how to play a new game like Geoguessr.

Your privacy is important

When developing Copilot Vision, we made your security, control and privacy our top priority. First of all, Vision is fully opt-in, so you decide when to activate it as your second eyes on the web. Additionally, once you end a session with Vision, all data about what you said and the context you shared with Copilot will be deleted. Every time you use Vision, your data will be processed and protected in accordance with Microsoft’s privacy policy. Only Copilot’s responses are logged to improve our safety systems.

Early feedback

Vision is still an experimental experience. As we roll this out, Vision will initially only interact with a select group of websites. Over time we will carefully expand this list. It is important to emphasize that Vision does not collect, store, or use data from publishers to train our models. In short, we value copyright, creators, and the privacy and security of our users – and put them all first.

We’re encouraged by early feedback and are working closely with a group of impartial testers outside of Microsoft to help us make this a useful and safe experience from the start. Some of those we’ve worked with are third parties to help us understand how Vision could be used to help people better engage and make decisions on their sites. These inputs will help us design Vision to be more helpful when interacting with web pages.

Availability

We are cautiously launching Vision, initially making it available to a limited number of Copilot Pro subscribers in the United States through Copilot Labs. As mentioned, Vision initially only works on a select group of websites. We’re taking the time to collect feedback, improve the technology, and will expand access to more Pro subscribers and more sites over time.

Thanks again to everyone who uses Copilot and provides feedback on what works and what can be improved. In this way, we will make AI more supportive and truly helpful. Join us on this journey: Learn more about Copilot Labs or see what you can do today with Copilot in Edge or Copilot on iOS, Android, and other social apps.