Here’s everything Apple announced at the WWDC 2024 keynote, including Apple smarts and Siri changes

Here's everything Apple announced at the WWDC 2024 keynote, including Apple smarts and Siri changes

It’s prime time for WWDC 2024! Every year, Apple kicks off its Worldwide Developers Conference with a few hours of back-to-back announcements, like the long-awaited Apple Intelligence and changes to its intelligent AI assistant Siri. We expected much of it to revolve around the company’s AI ambitions (more here), and Apple didn’t disappoint. We also bring you news about the Vision Pro and a number of feature updates.

 

Here's everything Apple announced at the WWDC 2024 keynote, including Apple smarts and Siri changes

Here’s how to watch the WWDC 2024 archive.

Developers should expect the same hardware and software updates as usual, and a few other things we initially thought would come out. Brian Heater also went into equities. Now you can sit back and relax while the team rounds up the most important stories in an easy-to-read summary.

Spotlight Search improves natural language queries in iOS 18
Apple makes it easier for people to find content within its apps using natural — or “semantic” — language queries. Spotlight was already able to search content in developer apps, but only returned results if search terms matched exactly. With the addition of semantic search capabilities this year, people will be able to search for content in apps using search terms that are similar in meaning. Read more

Here are the best features from WWDC 2024 you didn’t see
Now that people are using the developer beta and exploring sessions at the event, more features are showing up that weren’t announced on stage. Remember, only certain devices will be compatible with iOS 18 when it’s released later this autumn. Read more

iOS 18 cracks down on apps that request full access to your address book

Instead, Apple is adding a new two-step permission pop-up screen that will first ask users to allow or deny access to their contacts as before, and then, if the user allows access, will let them choose which contacts they want to share if not all of them. Read more

Apple Watch finally adds a feature I’ve been asking for for years

Brian Heater writes about a constant request for this particular feature from Apple: the ability to pause your activity loop. If you have a cold, you’re on an international flight, or you find yourself shaking your wrist frantically at 9 p.m. To close your loops, you can now pause progress via the watch itself or via a connected iPhone app

Apple Launches Sherlock Apps at WWDC 2024

Apple has been moving fast lately, announcing a number of new features for its various devices earlier this week. But many of these features were already available to some degree on Apple devices via third-party apps. So, as has been the case for the past few years, we’ll see ideas that Apple introduced “Sherlocked” into this year’s update.

Why does Apple take a little modular approach to generative AI?

Apple works with AI partners outside of OpenAI
At the event following the keynote, Apple senior vice president Craig Federighi confirmed that the company would work with third-party models other than OpenAI, and highlighted Google's Gemini model as the first example. He pointed out that Apple "has nothing to announce right now, but this is our general direction."

Elon Musk is bringing OpenAI and Apple together
Elon Musk, CEO of Tesla, SpaceX and XAI, took to X to continue his campaign against rival OpenAI, and threatened to "ban Apple devices from his business" if Apple integrates OpenAI at the operating system level, among other reactions and responses to the WWDC conversation about X.

Apple Intelligence Availability (Limited).

Before you get too excited about the Apple IQ test, check if your hardware is brand new. Only the iPhone 15 Pro and 15 Pro Max, along with iPad and Mac devices with M1 chips or later, will be able to run the new features that come with Apple's AI technology.

ChatGPT in Siri
Apple is bringing ChatGPT, an AI-powered chatbot experience, to Siri and other Apple apps, powered by OpenAI's GPT-4 and other generative AI models.

Apple Intelligence is a playground for images and emojis

An Apple Intelligence-powered feature coming to iOS 18 will allow iPhone users to create AI avatars of the people they send messages to — a feature that works similar to an AI-enhanced Bitmoji. Of course, the goal is to make your "everyday conversations more fun."

Apple Intelligence will have an understanding of who you're talking to in a messaging conversation, so if you want to personalize that chat with a custom AI photo, you can create one right away.

Apple TV+

For those of you who use Apple TV+, there's a new feature called InSight. The feature will allow viewers to see cast names and song titles as they appear on the screen. Lauren Forrestal writes that it's similar to Amazon's X-Ray technology, where Fire TV users get an overview of an actor's bio and behind-the-scenes information while watching TV shows and movies.

However, what stands out about InSight is its Shazam-like function, which highlights a song playing in a TV show or movie and gives users the option to add it to an Apple Music playlist for listening later.

SirI

Apple has also made some improvements to its smart assistant Siri. This includes adding some generative AI features that make Siri sound more natural and more personal. There's also a new flashing light. Siri can also handle impediments in speech and understand context better. Plus, those who like to type can now do so

Apple is smart here

The new feature is called Apple Intelligence (AI, get it?). The company promised that the feature will be built with highly personalized experiences as well as security in mind.

"The most important thing is that it should understand you and be based on your personal context, such as your routines, relationships, communications and more," CEO Tim Cook said at WWDC on Monday. "And of course, it should be built with privacy in mind from the ground up. All of this goes beyond artificial intelligence. This is personal intelligence, which is the next big step for Apple."

That covers the consumer side of things, but WWDC is a developer conference, and Apple has revealed how developers will soon be able to bring the Apple Intelligence experience to their software. Several AI features will be added to the existing software development kit (SDK), allowing for creating generic AI images or new instructions for Siri, allowing developers to expand the Apple Intelligence footprint.

The company has since revealed a few things that make its approach to generative AI different. First and foremost is scope. Many of the major companies in the space take a “bigger is better” approach to their models

Apple’s artificial intelligence, Apple Intelligence, is boring and practical, which is why it works

Rather than trying to overwhelm users with too many AI features to count, the Cupertino tech giant is carefully introducing AI where it thinks it can be useful. This means that technology will not be included because it could pose a significant threat to the carefully designed consumer experience of using an Apple device

Apple Messages will support RCS and text scheduling
Apple has delivered two of the biggest features of iMessage and the Messaging app that consumers have wanted for a long time: the ability to schedule messages to be sent at a later date and time and support for RCS, a next-generation messaging standard and SMS replacement that will make texting with Android folks a lot less painful. Is this the end of the green bubble?

More improvements to the App Store
Apple is giving developers more tools to increase their app revenue, promoting their apps with redemption offers and releasing a new commerce API.

iOS 18 compatible devices
One of the most prominent features of the new operating system version is a set of customization options, such as the ability to organize apps and tools on the home screen and customize buttons. Other features include new text effects, the ability to lock and hide apps, new ways to manage your inbox, satellite iMessages input, a major redesign of the Photos app, and more. Now let’s see if your device is compatible.

All the Apple intelligence news

There were a lot of them, right? Apple’s AI efforts were at the center of WWDC 2024, and AI expert Kyle Wiegers had to process all the announcements before compiling a guide to all the news on Siri, ZenMoji, ChatGPT integration, photo editing, and beyond

 

Apple works with AI partners outside of OpenAI
At the event following the keynote, Apple senior vice president Craig Federighi confirmed that the company would work with third-party models other than OpenAI, and highlighted Google’s Gemini model as the first example. He pointed out that Apple “has nothing to announce right now, but this is our general direction.”

Elon Musk is bringing OpenAI and Apple together
Elon Musk, CEO of Tesla, SpaceX and XAI, took to X to continue his campaign against rival OpenAI, and threatened to “ban Apple devices from his business” if Apple integrates OpenAI at the operating system level, among other reactions and responses to the WWDC conversation about X.

Apple Intelligence Availability (Limited).

Before you get too excited about the Apple IQ test, check if your hardware is brand new. Only the iPhone 15 Pro and 15 Pro Max, along with iPad and Mac devices with M1 chips or later, will be able to run the new features that come with Apple’s AI technology.

ChatGPT in Siri
Apple is bringing ChatGPT, an AI-powered chatbot experience, to Siri and other Apple apps, powered by OpenAI’s GPT-4 and other generative AI models.

Apple Intelligence is a playground for images and emojis

An Apple Intelligence-powered feature coming to iOS 18 will allow iPhone users to create AI avatars of the people they send messages to — a feature that works similar to an AI-enhanced Bitmoji. Of course, the goal is to make your “everyday conversations more fun.”

Apple Intelligence will have an understanding of who you’re talking to in a messaging conversation, so if you want to personalize that chat with a custom AI photo, you can create one right away.

Apple TV+

For those of you who use Apple TV+, there’s a new feature called InSight. The feature will allow viewers to see cast names and song titles as they appear on the screen. Lauren Forrestal writes that it’s similar to Amazon’s X-Ray technology, where Fire TV users get an overview of an actor’s bio and behind-the-scenes information while watching TV shows and movies.

However, what stands out about InSight is its Shazam-like function, which highlights a song playing in a TV show or movie and gives users the option to add it to an Apple Music playlist for listening later.

SirI

Apple has also made some improvements to its smart assistant Siri. This includes adding some generative AI features that make Siri sound more natural and more personal. There’s also a new flashing light. Siri can also handle impediments in speech and understand context better. Plus, those who like to type can now do so

Apple is smart here

The new feature is called Apple Intelligence (AI, get it?). The company promised that the feature will be built with highly personalized experiences as well as security in mind.

“The most important thing is that it should understand you and be based on your personal context, such as your routines, relationships, communications and more,” CEO Tim Cook said at WWDC on Monday. “And of course, it should be built with privacy in mind from the ground up. All of this goes beyond artificial intelligence. This is personal intelligence, which is the next big step for Apple.”

That covers the consumer side of things, but WWDC is a developer conference, and Apple has revealed how developers will soon be able to bring the Apple Intelligence experience to their software. Several AI features will be added to the existing software development kit (SDK), allowing for creating generic AI images or new instructions for Siri, allowing developers to expand the Apple Intelligence footprint.

Leave a Reply

Your email address will not be published. Required fields are marked *