Apple Intelligence is the Cupertino company's name for the AI that now sits at the beating heart of its operating systems on iPhone, iPad and Mac. But rather than being released in one go, Apple Intelligence features are coming in waves over 2024 and 2025. The first wav of Apple Intelligence features launched with iOS 18.1, iPadOS 18.1 and macOS Sequoia 15.1, in October and included Writing Tools, Notification summaries, Clean Up in Photos and a redesigned Siri.
The next wave, which we'll get in iOS 18.2, iPadOS 18.2 and macOS Sequoia 15.2, hopefully before Christmas, will include Genmoji for making your own emojis, and an Image Playground app for generating and manipulating AI images.
With Apple Intelligence, Apple is exploring how AI can help people in their everyday lives, with a big focus on privacy. It will help you write emails, perform natural language search and create memory movies based on prompts, but unlike the approach from Google and Microsoft, there is no plan to charge for access to Apple Intelligence's better features until at least 2027.
So, for the lowdown on Apple Intelligence, and how it could influence our list of the best AI phones, read on.
What is Apple Intelligence?
Apple Intelligence is Apple's multimodal, cross-platform approach to today's AI computing trend. It's coming to just about every Apple platform and most newer Apple devices. Apple Intelligence includes generative AI features, like writing and image creation, as well as an improved Siri assistant, and much more.
Apple Intelligence takes a decidedly Apple-like approach to privacy, which means that the least information possible is shared with anyone, even Apple itself. Most Apple Intelligence features run on your device. When Apple needs to access the cloud for more power, it has a Power Cloud Compute standard to protect your data and privacy; in a nutshell that means cloud-power without data spreading between a load of servers and platforms.
We mention privacy first because Apple always mention privacy first, and no other AI company talks about your data privacy and how your data is being protected quite as much as Apple does.
Apple is also giving Apple Intelligence unprecedented access to your data, and it will be able to read all of your messages, monitor your calendar, follow your Maps and location, record your phone calls, look at your photos, and understand any other personal data. Apple Intelligence will offer a new level of contextual features, because it will have access to just about all of your personal information.
What does Apple Intelligence do?
Apple Intelligence offers generative AI tools for writing and editing, image creation, and organization. It can also be able to offer summaries, just like current generative AI tools.
Wherever you can type or input text, Apple Intelligence offers Writing Tools to improve your writing. It can rewrite, proofread, and summarize text for you.
Apple Intelligence stays aware of your incoming Mail messages and your notifications, and it will try to prioritize what is important to you. All your notifications can be summarized by Apple Intelligence, so instead of an email notification showing you a partial part of the email, which might not be that helpful, you'll get a nice little summary instead.
Apple Intelligence also summarizes conversations and messages for you, and it can even summarize audio recordings. You can record phone calls and have Apple Intelligence summarize the conversation, or you can record in the Notes app and get a summary of the audio recording there.
A new Reduce Interruptions Focus mode uses Apple Intelligence to only offer high-priority messages that need your immediate attention.
For image creation, Apple has a new Image Playground app and tool on the way that is part of Apple Intelligence in iOS 18.2. With Image Playground, you can either enter your own prompt or use a suggested one, and the suggestions will be personalized based on what you're doing at the time. So for example if you message a friend about hiking in a forest, then 'forest' might be one of the prompts.
One of the most exciting features of Apple Intelligence is the new Visual Intelligence tool, which is coming in iOS 18.2. It works with the iPhone 16's new Camera Control button. Once you click the new button on the side of the phone you can use Apple Intelligence's multimodal features to get search results on the fly. Just point your phone at something and you can search for it!
You can select from several styles for your image, and you can also turn people in photos into cartoon-like images.
Besides the Image Playground, Apple will have an image generator that focuses on emoji as well. The generative emoji will be called Genmoji. You type a description, and an emoji appears. Again, we look forward to seeing this in iOS 18.2.
Apple has applied its generative AI tools to editing photos as well. There is a Magic Eraser-style tool called Clean Up that removes unwanted objects in photos and replaces them with a natural background. All you need to do is open a photo, then tap on Clean Up in the photo editor. Now tap, circle or brush over whatever part of the photo you'd like to remove with your finger, and let AI work its magic. If you do it on a person then it's as if they were never there.
Otherwise, Apple is using Apple Intelligence to assist in searching photos and videos so you can relive moments you'd thought you'd lost. You'll be able to search for a specific scene in a video, for instance. So, if you want a picture, or video, you took of your child wearing a blue t-shirt you can just type in their name and blue t-shirt to find it. You can also search for a category of photos and Apple Intelligence will put together a video presentation that fits your search. It will include photos and videos, as well as background music it selects.
If you want a full rundown of all the Apple Intelligence features, here's what we know is coming so far, or has already been released, and when you can expect them.
When will I get Apple Intelligence?
Apple Intelligence is already here! iOS 18.1, iPadOS 18.1 and macOS Sequoia 15.1 were released on 28 October and contained the first wave of Apple Intelligence features including Writing Tools, Notifications Summaries, Clean Up and an redesigned Siri.
iOS 18.1 still won't contain the main Siri upgrades. For that you'll have to wait until early 2025, when we can expect the last of the announced Apple Intelligence features, like the ChatGPT integration, to launch in iOS 18.2.
The next release of iOS 18.2, iPadOS 18.2 and macOS Sequoia 15.2 in December will see the inclusion of Image Playground and Genmoji.
Will Siri get Apple Intelligence?
Siri has already received a massive upgrade thanks to Apple Intelligence. From the release of iOS 18.1 onwards, Siri is no longer just a virtual balloon that sits at the bottom of your phone screen. Now, when you activate Siri, your entire home screen ripples, to show that Siri has completely taken over.
Siri is better all around, too. It has "richer language-understanding capabilities," according to Apple. It is more natural, and more contextually relevant. When you start a conversation with Siri, it now remembers what you were talking about when you make your next request, so you won't have to start over every time.
Also, Siri now accepts typing instead of just speech. If you never use Siri, it may surprise you to learn you couldn't type to Siri, but it's true. Now you can use the keyboard to give Siri commands and queries.
Siri also does a better job explaining how to use your Apple device. Whether you use an iPhone, iPad, or a Mac computer, Siri is able to answer thousands more questions about how to do things on your Apple product.
But the best is yet to come. In 2025, Siri will be able to know what is happening on screen, and it will make suggestions based on what it sees. It will also get full ChatGPT integration, so it will be able to have much smarter and complex conversations that it can currently handle.
Apple Intelligence is a major upgrade for Siri that will enable far more third-party actions. Using Apple's new App Intent API, app developers will be able to program commands that you can use with Siri.
Siri will also know you. It will know much more of the information you have on your device. You'll be able to ask Siri to "play that song Edgar mentioned" and it will know because it read your iMessage conversation with Edgar. If you ask "when is Dad landing at Laguardia" it will look up his flight details from the message he sent and give you real-time tracking info. That's cool, but it's a lot more than we're used to a computer knowing about us.
Based on what we've seen so far it looks like iOS 18.4 will finally deliver the Siri we've been waiting for.
How does Apple Intelligence protect my privacy?
Privacy is a key feature that sets Apple's AI apart from its competitors.
For a start, Apple is running everything it can on your device. While Siri may know everything you said in your text messages, it won't be sharing that information with anyone, not Apple or anyone else. At least, according to Apple.
When you create an image in the Image Playground, Apple doesn't know what image you've created. Even if your iPhone needs some help from the cloud when it summarizes the last phone call you made, it won't report anything to Apple.
Apple is keeping more complex cloud requests locked in a Private Cloud Compute environment, which 'cryptographically ensures that iPhone, iPad, and Mac do not talk to a server unless its software has been publicly logged for inspection,' according to the Apple Intelligence news release.
Will Apple Intelligence use ChatGPT?
iOS 18.2, iPadOS 18.2 and macOS Sequoia 15.2 will offer ChatGPT integration via Siri. Apple owners will be able to use ChatGPT to understand documents and images. We also know that Siri will be able to route a request through ChatGPT, if you ask nicely.
Apple is adding a level of privacy to these ChatGPT requests. According to Apple, when you access ChatGPT through Apple Intelligence, your IP address is obscured, and OpenAi won't store your request. Otherwise, ChatGPT's data-use policies apply.
ChatGPT is coming to all three major platforms – macOS Sequoia, iPadOS 18, and iOS 18 in December as part of the next OS releases, powered by GPT-4. However, Apple has also said that other AI models will become partners in the future as well. ChatGPT may not be the exclusive large-language model (LLM) partner for Apple Intelligence for long, if ever.
We've had a look at the iOS 18.2 beta, which includes ChatGPT integration in Siri, so we've seen it working and it's impressive. From what we've seen the integration is entirely opt-in, and Siri will flag when ChatGPT is answering a request.
Which Apple devices will get Apple Intelligence?
Apple Intelligence includes features across almost every Apple platform, including macOS 15 Sequoia, iOS 18, and iPadOS 18. Unfortunately, not every device that can run those operating systems will be able to use Apple Intelligence features.
Apple describe the iPhone 16 as the "first iPhone designed from the ground up for Apple Intelligence", and it will work with all its different models, the iPhone 16, iPhone 16 Plus, iPhone 16 Pro and iPhone 16 Pro Max.
Apple Intelligence is coming to devices that use the Apple M1, M2, M3, and M4 chips, as well as the A17 Pro chipset. That means even devices you can buy brand new today will not get the features later this year.
The current iPad Pro and iPad Air devices, as well as previous iPad devices that used the M1 and M2 chips, will all be supported. The base model iPad 10.9 and the iPad mini will not be supported, as they use older Apple Bionic chips.
The only older iPhone models that will work with Apple Intelligence are the iPhone 15 Pro and iPhone 15 Pro Max. The iPhone 15 and iPhone 15 Plus use the A16 Bionic chipset, and not the A17 Pro chips.
If you have a Macbook Air, Macbook Pro, iMac, Mac Studio or Mac mini with an M1 chip or newer inside, you should be fine. Apple computers with an Intel processor on board will likely not be supported.
You might also like...
