Matt Wolfe breaks down Apple's new AI features from WWDC. Siri can now buy tickets, analyze Instagram photos for directions, and identify objects in real time through the Camera app. His favorite: describe what you want automated in plain English and Siri builds the Shortcut for you.
The AI world is buzzing about Apple's WWDC event. A big chunk of this keynote was dedicated to like the Siri that we kind of always hoped Siri would be. They asked about tickets for a concert and it told them they had to enter a lottery. And then he set a reminder to enter the lottery at that time. He showed it a picture on Instagram and asked where it was. And it looked at that picture, figured out where it was, and then gave him directions to where that was. You know, he was rearranging photos by dictating to Siri. Another thing I found kind of interesting is if you're on like a Mac or a MacBook, Siri's going to come to Spotlight. So, you know, if you hit Command Spacebar and bring up this little Spotlight search, you're gonna be able to prompt it with AI and say, you know, "Rearrange these folders," or "Look at all of these documents and tell me the differences between 'em," things like that. They're also adding a new Siri mode in the camera app. So in this picture, they're pointing it at a red ball, and because they're in Siri mode, Siri starts telling 'em, "This appears to be a traditional cricket ball," et cetera. Now, out of the entire keynote, this was the thing I was probably the most excited about about. So they're adding this feature called Describe a Shortcut, which allows you to use AI to say, here's what I want to happen, and it will actually go and build that shortcut for you. Like, you just say, when I'm leaving work, message Pedro, I'm on my way with my ETA, and it will actually go and build that shortcut for you. I like never use the Shortcuts feature, but if I can just like explain what I want it to do and it goes and automatically figures out how to build that shortcut for me, that'd be pretty cool, I think. they're actually going to be using their own foundation models as well as Google's Gemini models. They explain that when you use Siri's AI on the phone, it's either going to handle that AI prompt on the phone directly or using private clouds where Google gets none of your data saved. Okay.
AI News: Dots, GPT-6.1 Sol, Sonnet 5.5, Gemini 4, and everything you need to know
