Apple’s upcoming Worldwide Developers Conference is set to be a landmark event in the tech giant’s history. During the conference, the Cupertino-based company will unveil its integration of AI technology across its devices and software. This includes a groundbreaking partnership with OpenAI. As the event draws near, numerous leaks have surfaced, shedding light on the features and capabilities expected in iOS 18.
Among the anticipated updates, Apple appears to be leveraging its Ajax LLM to fuel some new AI functionalities. It’s also rumored that Apple will process AI data in a secure manner that even employees can’t access, thereby continuing its commitment to user data privacy.
Below, we explore how Apple plans to incorporate AI into its apps and services in the forthcoming iOS 18 update, along with other enhancements.
Siri’s AI-Powered Transformation
Apple’s digital assistant Siri is set for a significant AI-driven enhancement. Utilizing Apple’s own large language models, Siri will gain the ability to control specific features within apps without requiring upfront configurations like App Intents or Siri Shortcuts. For instance, users will be able to ask Siri to delete emails or edit photos directly.
However, not all features will be available immediately. Complex multi-step tasks managed by Siri are expected to be delayed until next year. Moreover, an advanced Siri will be available on Apple Watch, enabling users to control music on another device via voice commands. Other enhancements include more natural-sounding voices and the ability to summarize notifications related to contacts, companies, calendar events, and more.
Apple Photos’ AI Makeover
A refreshed interface for Apple Photos is on the horizon. Users will be able to retouch their photos using AI capabilities, competing with Google Photos’ features. A “Clean Up” function will allow the removal of objects from images using generative AI technology, similar to Google’s Magic Eraser. Internally, Apple has developed a Generative Playground app for creating and editing images, which could potentially integrate into iMessage.
Safari Gets Smarter
Safari will see AI-supported recaps of web pages and news articles through a new Intelligent Search feature.
Enhanced Notes App
The Notes app will benefit from AI-generated recaps and audio transcription. It will support in-app audio recording and summarization alongside a Math Notes feature for graph creation and solving equations. Users might also see auto-completion options for mathematical equations. Known internally as Project Greymatter, these AI tools will integrate into core apps like Safari, Photos, and Notes.
Voice Memos with Real-Time Transcription
Real-time transcription capability is coming to Voice Memos.
AI Enhancements in iMessage
Generative AI will allow users to create customized emojis and provide AI-generated recaps of missed texts. Deeper Siri integration, new Tapback icons, and message effects for specific words are also expected. Additionally, iMessages will offer AI-suggested replies and RCS support, introducing read receipts, typing indicators, and high-quality media when communicating with Android users.
Revamped Calendar App
Apple’s LLM will interact with the Calendar app to check for events when composing message responses.
AI-Supported Mail
The Mail app will feature AI-suggested email replies generated by Ajax.
Redesigned Settings Interface
The Settings app will receive a revamp for better organization and improved search functionality.
Control Center Updates
A new Music widget featuring larger artwork may be introduced, along with improvements to HomeKit for better smart home integration.
Enhanced Notifications
AI-generated recaps of missed notifications are coming, and Apple is developing “Enhanced” notifications.
Faster, More Reliable Spotlight
Spotlight is set to become quicker and more reliable in its searches.
Home Screen Customization
iOS 18 will allow users to place app icons freely on the home screen, breaking away from the traditional grid alignment. Icon color customization will also be introduced, reminiscent of Google’s Material You.
Custom Route Creation in Maps
The Maps app will support custom route creation, enabling users to design personalized routes for trips.
AI-Powered Playlists in Apple Music
Apple Music plans to rival Spotify with its AI-driven, auto-generated playlists.
Additional Enhancements
Other apps, such as Freeform, Xcode, and productivity apps like Keynote and Pages, are also poised to receive generative AI features.
Stay tuned for the official unveiling at Apple’s Worldwide Developers Conference next week.
