Apple's Siri overhaul: Deep integration is the win

Apple at WWDC unveiled a deeply integrated Siri overhaul, delivering on its 2024 promise of a smarter AI assistant with personal context, onscreen awareness, and multimodal capabilities. The new Siri, powered by Apple Foundation Models co-developed with Google, can reference and act on information across messages, emails, and photos, and will be accessible via voice, button press, or a standalone app across iPhone, iPad, and Mac. This native integration across Apple's ecosystem positions the company to compete by embedding AI features directly into device functions rather than relying on a separate chatbot interface.

Two years after promising a smarter Siri, Apple delivered at WWDC, unveiling an AI assistant set to change how users interact with their devices. The company made good on the previously announced features, including a Siri with personal context that understands your messages, emails, and photos, plus onscreen awareness for more seamless assistance. We also got new details about the experiences coming this fall, fueled by a smarter, more capable and more conversational Siri. The additional context will allow Siri to take more action; for instance, you can ask Siri to reference something in a text and then act on it, such as "What was the hotel information that Jason emailed me about? Can you add it to my calendar?" This, combined with on-screen awareness and up-to-date world knowledge, should address the annoying context gaps that Siri presented users in the past and made it difficult for them to get anything done. Other new Siri-fueled features include: More voices : Users can customize Siri's expressiveness and pace. Improved dictation : When users speak, there will be more polished text with greater precision, handling capitalization, punctuation, and formatting similar to Wispr Flow and Google Rambler . Standalone Siri app : This makes it easier to either revisit past conversations or start a new one, and access them all across different Apple devices. Visual Intelligence : Baked directly into the iPhone's camera app, users can tap the shutter button to give Siri context for what they are seeing and tap into its multimodality. It is also coming to iPad and Mac, via a screenshot or keyboard shortcut, respectively. Writing Tools : Users can activate Siri AI writing assistance virtually anywhere they type. Siri AI will adhere to the user's typical communication patterns. Lastly, Siri now automatically proofreads for users. Powering it all is a new architecture for Siri AI, built on Apple Foundation Models https://machinelearning.apple.com/research/introducing-third-generation-of-apple-foundation-models co-developed with Google. Apple said these devices could run both on-device and on servers via Private Cloud Compute. To access Siri, users can now say "Hey Siri," press the power button, or swipe down from the Dynamic Island. On Mac and iPad, it is also integrated into Spotlight. Our Deeper View Apple finally delivered on its big AI promises from 2024, and that in itself is a win for Apple users. However, in the larger market, there is a major caveat: the company is ultimately playing catch-up with what other major smartphone manufacturers have been shipping for years. From today's announcements, it seems Apple's biggest competitive edge is how deeply it's integrating its AI features natively. For instance, the updated Visual Intelligence operates directly from the camera app or personal context, integrating knowledge across all Apple applications. As I've been saying since 2024, Apple's best strategy is moving AI from a chatbot app you have to open to a bunch of really smart features in all the places where they make the most sense on your phone and other Apple devices.