Apple TV 4K to get AI-enhanced subtitles, Amazon X-Ray-style info while watching, and clearer dialogue in tvOS 18

Apple tvOS 18 being discussed by presenter in living room setting
(Image credit: Apple)

Apple announced a suite of enhancements coming to tvOS 18, the next version of its Apple TV 4K operating system, at WWDC 2024 (you can see all the info as we learn it at our WWDC 2024 live blog). The new features are available to Apple developers in a tvOS 18 beta version today, and will be launched in an official version later this fall.

The announcements led off with InSight for the Apple TV app. Similar to Amazon Prime Video’s X-Ray feature, this shows onscreen information about characters, actors and even background music tracks for Apple TV Plus movies and shows. The data can be accessed in real-time and is also available when using an iPhone as a remote to control the Apple TV 4K.

The Apple TV 4K Enhance Dialogue feature is getting an AI-driven boost in tvOS 18 to improve the clarity of voices over background noise and music when watching movies and TV shows. According to Apple, Enhance Dialogue can now be used with a TV’s built-in speakers, HomePod or HDMI-connected speakers, AirPods, and other Bluetooth devices.

Subtitles are also being overhauled in tvOS 18, with onscreen text now automatically popping up when you mute the volume or scan back when watching programs. Subtitles will also be generated when the language doesn’t match the selected language for the device, so viewers will never have to worry about missing a line of dialogue.

The best 4K projectors can be used to display images in the ultra-wide 21:9 aspect ratio and new updates coming to tvOS 18 will bring 21:9 format support to the Apple TV 4K. This will allow pictures to be shown on 21:9 aspect ratio screens with no horizontal black bars at the top or bottom – just like in a movie theater.

The Enhance Dialogue feature in tvOS 18

The Enhance Dialogue feature in tvOS 18 (Image credit: Apple)

Screen savers, FaceTime and Apple Fitness Plus 

Other enhancements coming in tvOS 18 will make the Apple TV 4K more fun to watch when in screen saver mode, and make FaceTime calls more accessible.

Screen saver options now include a Portraits mode that uses photos from your library that can be customized with text, color, and graphics. This will be accompanied by a TV and Movies option with select scenes from content on Apple TV Plus, as well as a Snoopy and Woodstock animation for Peanuts fans.

FaceTime calls in tvOS 18 can be made on the big screen with live captions automatically generated in English when making FaceTime calls. The feature, which is only available in the US and Canada, will improve the Apple TV 4K’s accessibility by letting users read as well as listen to conversations.

Lastly, the Apple Fitness Plus app gets a redesign in tvOS 18, with new features being added that provide a personalized For You space, enhanced awards, and extended search features.

Apple has not yet specified which Apple TV devices will get these upgrades, though it's safe to assume the latest Apple TV 4K (2022) will benefit.

You might also like...

TOPICS
Al Griffin
Senior Editor Home Entertainment, US

Al Griffin has been writing about and reviewing A/V tech since the days LaserDiscs roamed the earth, and was previously the editor of Sound & Vision magazine. 

When not reviewing the latest and greatest gear or watching movies at home, he can usually be found out and about on a bike.

Read more
The Prime Video homepage with The Boys TV show poster displayed
Prime Video just launched a new app for Apple TV devices with 6 major improvements
Apple Vision Pro Review
Apple Intelligence finally arrives on Vision Pro, but it's the new iOS app that might turn heads
The Apple logo is seen with the iOS 18 operating system logo in the background on a mobile device
I installed iOS 18.4 beta and the big Siri intelligence update is nowhere to be found
Apple TV 4K review
Next-gen Apple TV 4K tipped to land in 2025 with a Wi-Fi surprise
iOS 18 Control Center
iOS 18.4: 5 new features to expect, including Ambient Music and Photos filtering
iOS 18
iOS 18: new features, compatible devices, and everything you need to know
Latest in Televisions
Sony Bravia 9 backlight demo showing images on screen and on raw backlight
TCL overtaking LG's premium TV sales is the inevitable result of OLED's biggest problem and mini-LED's biggest strength
Next-Gen Google TV
Google TV's Gemini Live support and other updates seemingly confirmed by new user survey – here's what to expect
Hisense U8N showing colorful landscape
I test TVs for a living, and these 4 TVs are the best for bright rooms and beating reflections
An array of Genelec speakers with. a Samsung soundbar in the middle at the Samsung Audio Lab
‘Atmos content costs too much money’: Samsung told me why Dolby Atmos isn't the future of surround sound, and why it launched Eclipsa Audio
Samsung S90C in front of gray background displaying pink demonstration image
Infuriating pop-up appearing on your Samsung TV? You're not alone – but there may be a fix
The Alpha 9 processor in an LG TV
This is the most important part of your new 4K TV if you're buying on a budget like me – and it's not the pixels
Latest in News
Google Gemini iPhone Lock Screen
You can now access Gemini from your iPhone's lock screen
Michelle, Keats, and Doctor Amherst looking unimpressed and worried in The Electric State
Netflix drops trailer for The Electric State, and I'm getting serious District 9 vibes
YouTube TV
YouTube TV might be planning a big Netflix update that puts the best streaming services first
Google Pixel 9 Pro
Here are the 7 best Pixel 9 and Pixel Watch 3 features landing in March’s Pixel Feature Drop
Bang & Olufsen Beogram 4000C Saint Laurent Rive Droite Edition
Bang & Olufsen's latest reworked turntable is a masterpiece of retro revival, in a breathtaking wooden presentation box
Apple Watch Series 10
Apple unveils new Apple Watch bands – here's what's in the Spring 2025 collection