Microsoft Teases Copilot Vision, The AI Sidekick That Judges Your Tabs

Microsoft has rolled out a Copilot Vision preview that says more about how poorly websites are designed rather than justifying the need to bring more AI into users' lives.

The preview is only available to Copilot Pro subscribers, and only in the US for the time being. The service "looks" at the website a user is viewing to provide contextual suggestions and insights.

Doing some holiday shopping? Copilot Vision can suggest products that match a user's needs and preferences. Thinking about taking a trip to a museum? Copilot Vision will highlight what a user might need to know. And so on.

Microsoft said: "Browsing no longer needs to be a lonely experience with just you and all your tabs," which makes The Reg wonder exactly what the company thinks its users are like. The tool will only work with Microsoft's browser and is accessed from the base of Edge's window.

"It's almost like having a second set of eyes as you browse," said Microsoft. "Just turn on Copilot Vision to instantly scan, analyze, and offer insights based on what it sees."

It is debatable if Copilot Vision would even be required if every website was designed with the user in mind.

• Windows 11 24H2 rolls out to more devices – with a growing list of known issues
• Microsoft says premature patch could make Windows Recall forget how to work
• GitHub's boast that Copilot produces high-quality code challenged
• Microsoft preps big guns to shift Copilot software and PCs

It also sounds like a potential privacy disaster, which is why Microsoft is keen to insist the service is "entirely opt-in." It is up to the user to decide when to turn it on. In addition, any shared data is deleted. However, remember that the service is governed by Microsoft's Privacy Statement, meaning the company could theoretically collect data for its own purposes.

That said, in stark contrast to the original unveiling of Recall, Microsoft is taking a tentative approach with this feature. The company said: "It's important to stress that Vision does not capture, store, or use any data from publishers to train our models. In short, we're prioritizing copyright, creators, and our users' privacy and safety – and are putting them all first."

Copilot Vision was first announced in October, and this week's broader release reflects early feedback. It will also only work with a select set of websites. Microsoft said: "We're taking our time to gather feedback, iterate on the technology, and will expand access to more Pro subscribers and more websites over time." ®