Skip to main content

This Apple AR patent could turn any surface into a touchscreen

Apple Glass - Apple logo seen through a pair of glasses
(Image credit: Shutterstock / Girts Ragelis)
Audio player loading…

An Apple patent has demonstrated how the tech giant could combine augmented reality with thermal technology to generate a virtual touchscreen on practically any surface, making use of thermal cameras built into a potential AR glasses device.

Spotted by Patently Apple (opens in new tab), the technology known as Thermal Touch was developed by tech company Metaio, which Apple acquired back in 2015. Put as simply as possible, the technology combines information drawn from infrared sensors with an AR display to generate a workable touchscreen.

Thermal Touch recognizes the heat generated from touching a surface, and registers that as a command, making the virtual interface interactive. Projected applications could come in the form of virtual keyboards or potentially full touchscreen displays if Apple’s rumored AR glasses are powerful enough to handle the processing required.

The magic touch

In the above video released in 2014, prior to Apple’s acquisition of the company, Metaio CEO Dr. Thomas Alt explains potential applications of Thermal Touch technology, and that “the world” can become a touchscreen as a result. A major – and impressive – example shown involves a user touching an image of a jacket in a magazine to produce shopping results.

Other interesting examples shown in the video include a fully virtual chess game, with individual pieces recognizing – and being able to be moved by – Thermal Touch input. It was perhaps Metaio’s working prototype that caught Apple’s attention in the first place.

We can assume that Apple and Metaio have been developing Thermal Touch technology for some time, then, and we’ve seen lots of eyebrow-raising rumors surrounding Apple’s AR smartglasses, from generating virtual objects to compatibility with haptic socks. Yes, you read that right.

While this is all still largely based in conjecture, the steady trickle of rumors and patent reveals show that Apple’s development in augmented reality could be quite a leap forward for the nascent technology. Analysts suggest that the glasses could go to market as early as 2022.

Rhys Wood
Rhys Wood

Rhys is Hardware Writer for TechRadar Gaming, and while relatively fresh to the role, he's been writing in a professional capacity for years. A Media, Writing and Production graduate, Rhys has prior experience creating written content for app developers, IT firms, toy sellers and the main TechRadar site. His true passions, though, lie in video games, TV, audio and home entertainment. When Rhys isn't on the clock, you'll usually find him logged into Final Fantasy 14, Halo Infinite or Sea of Thieves.