Microsoft's Copilot can now browse the web with you, if you're in the early preview

Microsoft Copilot Vision
(Image credit: Microsoft)
  • Microsoft's AI assistant can now see in the Copilot Vision preview
  • Now out in a limited beta for a select few, Copilot can browse the web in Edge
  • It's entirely opt-in, but you'll be able to converse with Copilot about what you're seeing

Similar to how Windows Recall will give AI access to what’s on your screen, Microsoft’s rolling out a similar experience for Copilot in a limited preview. Originally teased alongside the redesign of Microsoft’s AI assistant, Copilot Vision is now rolling out as an early preview for a select few in the United States.

As the name suggests, it will let Copilot see what’s on your screen, specifically within Microsoft’s Edge browser, so it can essentially browse the web with you. This way, you can hit it with topical questions about what you’re seeing – be it an illustration, a video, type-based text, or even handwriting. And no, you won't need to type these out, but you can converse with Copilot with just your voice.

In an announcement post published by Microsoft, Copilot Vision is described as: “When you choose to enable Copilot Vision, it sees the page you’re on, it reads along with you, and you can talk through the problem you’re facing together. Browsing no longer needs to be a lonely experience with just you and all your tabs.”

Co-shopping with Copilot Vision - YouTube Co-shopping with Copilot Vision - YouTube
Watch On

It seems like it’s almost being pitched as a companion, so if you’re browsing a shopping website like Amazon or Zappos, you could potentially ask for suggestions about what you’re looking at. Moreover, though, if you're browsing restaurant reviews, you could ask if any mention a specific event – like good for anniversaries – or ask for other recommendations. Seeing how it’s built directly into Edge – if you opt-in – Microsoft seemingly hopes that it’ll be called upon quite a bit and prove to be useful.

Microsoft is also sharing three of Copilot Vision being used for shopping, planning a trip to a museum, and gaming. The latter is almost similar to Game Assist in Edge, which reduces the need to alt-tab.

Suppose you’re concerned about privacy with Copilot Vision, which may be similar to Recall, which finally launched in November in beta. In that case, you'll be happy that Microsoft is taking a better approach with this new AI feature. It’s entirely opt-in and is only currently available via Copilot Labs to a limited number of Copilot Pro subscribers in the United States.

Co-planning with Copilot Vision - YouTube Co-planning with Copilot Vision - YouTube
Watch On

Furthermore, in its current build, Copilot Vision is only available for a select set of websites, and it seems Microsoft will only expand on that when it deems it ready to do so. Slow and steady will be the approach for adding more subscribers and expanding the sites it works with; Microsoft explains: “We’re taking our time to gather feedback, iterate on the technology, and will expand access to more Pro subscribers and more websites over time.”

If you’re in the early beta of Copilot Vision, another win is that after the session, the associated data and the context it’s used within will be deleted. So that information does not stick around Copilot, only the response to the tools “are logged to improve our safety systems,” says Microsoft.

If you’re keen to give it a go and are a Copilot Pro subscriber in the United States, you can check via Copilot Labs to see if Copilot Vision for Edge is available as a preview for you.

Co-gaming with Copilot Vision - YouTube Co-gaming with Copilot Vision - YouTube
Watch On

You might also like

Jacob Krol
US Managing Editor News

Jacob Krol is the US Managing Editor, News for TechRadar. He’s been writing about technology since he was 14 when he started his own tech blog. Since then Jacob has worked for a plethora of publications including CNN Underscored, TheStreet, Parade, Men’s Journal, Mashable, CNET, and CNBC among others.

He specializes in covering companies like Apple, Samsung, and Google and going hands-on with mobile devices, smart home gadgets, TVs, and wearables. In his spare time, you can find Jacob listening to Bruce Springsteen, building a Lego set, or binge-watching the latest from Disney, Marvel, or Star Wars.

Read more
Microsoft Copilot Vision
Microsoft Copilot Vision is the perfect holiday shopping buddy, and it’s finally here
Copilot on a laptop
What is Copilot: Microsoft’s AI chatbot isn't just for Windows users
Microsoft AI Windows Search
Microsoft wants AI to make searching for files a more casual experience
A woman sitting in a chair looking at a Windows 11 laptop
Windows 11 is set to offer the option nobody was crying out for – having Copilot automatically load in the background when the PC boots
Microsoft Copilot on a laptop.
I think Microsoft is smart to follow OpenAI in making these premium features free
Microsoft Paint Copilot
Microsoft Paint brushes up on AI
Latest in Computing
An AMD Radeon RX 9070 XT made by Sapphire on a table with its retail packaging
Last-minute AMD RX 9070 XT stock rumors are making me hopeful for a much better launch than Nvidia’s RTX 5000 GPUs – with just one snag
Microsoft Store logo on a blurred background
There's finally a fix for an annoying Microsoft Store bug that's older than Windows 11
The Nvidia and AMD logos clashing with lightning bolts around them.
Sure, Nvidia DLSS 4 is incredibly impressive - but AMD's improved upscaling tech could be a real game-changer
Google AI Mode
Google previews AI Mode for search, taking on the likes of ChatGPT search and Perplexity
ChatGPT Deep Research
I can get answers from ChatGPT, but Deep Research gives me a whole dissertation I'll almost never need
An AMD Radeon RX 9070 XT made by Sapphire on a table with its retail packaging
Where to buy AMD Radeon RX 9070 XT and RX 9070: these are the best retailers in the US and UK
Latest in News
Fujfilm GFX 50R
First Fujifilm GFX100RF images leaked in build-up to expected reveal – here’s what they tell us about the unique premium compact camera
Samsung Galaxy Z Flip 6 in blue
The Samsung Galaxy Z Flip 7 could have a Motorola Razr-style full-sized cover screen – and I think it’s about time
An AMD Radeon RX 9070 XT made by Sapphire on a table with its retail packaging
Last-minute AMD RX 9070 XT stock rumors are making me hopeful for a much better launch than Nvidia’s RTX 5000 GPUs – with just one snag
eSIM
Global eSIM shipment volume surpasses half a billion units as demand keeps on growing
Samsung Galaxy Buds in white
Samsung may be working on new cheap wireless earbuds – will the Galaxy Buds FE 2 beat Sony's next value earbuds to the punch?
PS5 Pro feature
PlayStation Direct now lets you rent, yes rent, a PS5 from £11.99 a month