Rumored Apple VR headset won't use controllers – it'll use your eyes and hands

A person wearing a VR headset with the Apple logo on
(Image credit: Future)

The long-rumored Apple VR headset is expected to launch later this year at WWDC 2023, and when it does it might arrive without one accessory that pretty much every rival device relies on: controllers.

While devices like the Meta Quest Pro and its predecessor the Oculus Quest 2 do offer handset-free hand-tracking options, their controllers are still the main way that users interact with the virtual world; while there are several apps that support hand-tracking, there are significantly more experiences that require users to interact with the world using their controllers.

But Apple seems keen to ditch cumbersome handsets, with Bloomberg’s Mark Gurman – who has a solid track record with Apple leaks – suggesting that users will instead interact with Apple’s VR interface using their hands and eyes.

According to Gurman, Apple headset users will look at the app they want to open, and then reach out their hand and pinch their thumb and index finger together to open it. Plus, while Apple is apparently still developing a virtual keyboard for users to type on, at launch headset wearers will instead have to rely on the Siri voice assistant to turn their speech into text for typing.

However, none of this is to say that you won’t be able to pair external hardware with the Apple headset. Apple is the king of interoperability between its devices, and this headset won’t buck the trend – it will reportedly be able to serve as a second monitor for your Mac computer, and you'll be able to use your iPhone and iPad’s keyboard for typing.

MacBook Pro 16-inch (2023) in use in a studio

The VR headset can apparently serve as a second monitor for devices like the MacBook Pro 16-inch (2023) (Image credit: Future)

As with all leaks and rumors we should take Gurman's claims with a pinch of salt, although as mentioned, he is fairly reliable, and the information tracks with the fact we've heard very few details about the headset's handsets. If the device is launching this year, and with controllers, we should have heard some design or spec details about them by now; however, beyond the odd patent, we've not heard anything, whereas we already know a fair amount about the headset itself, which may suggest that it is indeed controller-less.

Analysis: a hand-tracking upgrade is in sight

If you’ve used a VR headset’s hand tracking then you might be a little worried about Apple’s headset being wholly reliant on it. While I’ve been impressed by the version of the feature employed by Meta’s Quest Pro, and even its older headsets like the Quest 2, the tool isn’t quite as competent as I’d like; currently, too few apps support it, and the tracking isn’t accurate enough for me to ditch controllers altogether.

However, I think Apple’s VR setup could give its version of the tool an edge, and that’s thanks to its use of eye-tracking.

I’ve found that hand tracking on Meta's Quest devices struggles most in menus. If you’re in a game and go to pick up an object it works really well, but the moment you have to point and interact with a menu at a distance things can start to feel subpar. Apple’s headset sounds like it will solve this inaccuracy issue with eye-tracking – rather than simply relying on a user’s gestures, the device may be able to better infer the wearer’s intentions by using where they’re looking as an extra data point.

The Meta Quest Pro

The Meta Quest Pro could use its eye-tracking to improve its hand-tracking, but its currently held back by Quest 2 compatible software (Image credit: Future)

We’ll have to wait and see exactly how Apple’s VR headset works if and when it’s finally unveiled later this year, but if its hand tracking is an upgrade over what’s come before then I expect we’ll see Meta and others deploy updates to their systems – at least those with eye-tracking, like the Quest Pro. 

Perhaps in response to this Meta seems to be prepping an exciting hand-tracking update on the Quest 2 and Quest Pro, though it's yet to be seen if this upgrade is as good as we hope it will be.

The XR space isn't just a battle between Apple and Meta, of course. Check out our hands-on experience with the HTC Vive XR Elite, and our rundown of all the VR, AR, and MR headsets at CES 2023 to get a better understanding of what 2023 has in store for the metaverse.

Hamish Hector
Senior Staff Writer, News

Hamish is a Senior Staff Writer for TechRadar and you’ll see his name appearing on articles across nearly every topic on the site from smart home deals to speaker reviews to graphics card news and everything in between. He uses his broad range of knowledge to help explain the latest gadgets and if they’re a must-buy or a fad fueled by hype. Though his specialty is writing about everything going on in the world of virtual reality and augmented reality.