Apple's Huge AI Unveiling (AI For Everyone!)

So today was Apple's wwdc, or Worldwide Developer Conference, and they made a ton of announcements. Now, most of the announcements, I feel like, were fairly minor quality of life announcements for most of the various operating systems. But a massive portion of this presentation was dedicated towards all of the AI features that Apple's about to roll out. So I'm going to skip over a lot of the new iOS updates, if that's what you're interested in. I'm sure there's plenty of videos that break that down, but I want to focus on the AI stuff that's getting added to the Apple ecosystem. Let's dive in. Now, the first mention of machine learning was when they were talking about the new Vision OS for Apple Vision Pro. Now, with the Apple Vision Pro, you can view spatial images, so images that look like they have depth to them because you're seeing it with both eyes. Well, they're rolling out a new feature for the Vision OS where you could take any of your 2D images and convert them into spatial images. Now, to me, this looks very similar to what we get out of something like Leia, which can also take a 2D image and using AI, turn it into a 3D image. Now, fast forwarding through the keynote a little bit to where they got to iOS updates. There's a major update to the iOS Photos app. It's got a complete redesign, but they're also adding a semantic search to it, as well as automatic categorization of your photos. So similar to what we've had in Google Photos for a long time now, it'll now automatically categorize your photo by people, location, location, favorite memories, things like that. And with the semantic search, you can search for things like that day I caught a huge fish. And it'll try to find all the images of you holding up a huge fish. The airpods are getting a minor AI update with voice isolation. So if you're in a noisy environment and you have your AirPods on and you're talking to somebody, it isolates just your voice and tunes out all of the noise around you, so it should sound crystal clear to whoever you're talking to on the other end of the phone. The Apple Watch also got some AI updates, Probably the coolest update being that when you're in a new location, your Apple Watch detects that new location. And if it's a location that speaks a different language than you, it'll automatically recommend on your watch the translation feature. So let's say I'm traveling to Japan when I'm in Japan. I look at my watch, it'll say, would you like to use the Japanese translation feature? And then I can speak in English into my watch and have it translated in Japanese back out to whoever's near me so I can ask questions like, how do I get to the bus station? It'll translate it into Japanese, speak it back out from my watch, and I can have conversations with people in a different language. Now, you can already do this with your iPhone, but now we're going to get it on our watch as well. Now, in my opinion, one of the coolest things that they showed off during this keynote was actually on the iPad. Now, one of the things that has been glaringly missing from the iPad for a long time is a calculator app. And they finally announced a calculator app on the iPad. Now, why is that a big announcement? Well, because their new calculator app on the iPad is really, really cool. It has a feature called Math Notes where you can actually write out the math problems with your Apple pencil on the iPad and it will solve those problems and it will solve very complex problems as well, not just simple addition and subtraction problems. In the demo, they were showing people drawing full on graphs and asking for angles on certain portions of the graphs and charts and diagrams. And it just does a lot of really, really cool stuff and was probably the biggest showstopper moment from the entire keynote. They also added this Math Notes feature into the Notes app, so you can solve math problems directly inside of the Notes app as well. But the Notes app, you can handwrite stuff into that app. It will actually learn your handwriting, clean it up so it's easier to read, and then actually write future stuff. You ask it to write in your handwriting. That all uses machine learning and they call that smart script. The Mac OS also got some big updates. I'm not going to go through them all, but they also added that same Math Notes feature into Mac os. So you can do that directly on your desktop or MacBook as well. They've added iPhone mirroring. And I know this isn't an AI feature, but it's one of the cooler features that I thought they showed off. You can have your iPhone completely on the opposite side of your house, but you can actually use and access your iPhone just like it was in your hand, but use a mirrored version of it on your computer and your actual phone will stay locked. So if somebody walks by your phone and looks at your phone, they can't actually see what's going on on your phone, but you could be actually operating your phone from your Mac os. Again, not AI, but something that I thought was a really cool feature. Safari is getting some new updates as well, including a highlights feature where if you go to an article on the web, it will sort of highl the most important information from that article and surface it to the top for you. It also creates an automatic table of contents for the articles you're reading and creates a summary of the article that you're reading so you can get a quick overview of what you're about to read before you read the entire thing. They've also got special viewers for articles and videos that sort of remove all the clutter around the content so you can read an article without the ads and you can watch a video sort of in a full cleaner screen directly in Safari. And that was pretty much the majority of the AI features that they showed off in the various operating systems from Apple. However, the keynote was only halfway through at that point because the whole second half of the keynote was completely focused on all of the AI stuff that Apple was doing. So you've been learning about all this AI stuff, but maybe you don't know what to do with it yet. Despite all the doom and gloom about AI taking people's jobs, you can actually leverage AI tools to present yourself as the perfect candidate for for whatever your dream role is. And that's why I partnered with HubSpot to show off their new toolkit which will help you land the perfect job leveraging AI. This kit includes guides like 20 AI powered tools for job seekers, which by the way, some of these tools even I didn't know existed. The kit also includes the guide 60 Ways to Use Chat GPT during your job search, including tips on how to be a better negotiator, which I don't care if you're looking for a job or not, learning how to be a better negotiator is a pretty good skill to learn, and that's just scratching the surface of all of the resources that are available inside of this toolkit. So if you're out there job hunting right now or thinking about a career change, or you just want to uplevel your skills for in case you need them in the future, HubSpot's completely free kit, all about how to land a job using AI is something I highly recommend you check out. Again, it's completely free. I will link it up in the description below. And thank you so much to HubSpot for sponsoring this video. They call it Apple Intelligence, which is really smart because it's still AI. It's just Apple Intelligence instead of artificial intelligence. The goal is to build an AI across their sort of Apple ecosystem that understands you. It knows your calendar, your emails, your notes, the apps you use, who you message often, your contacts, all of that sort of stuff. It sort of cohesively makes all that stuff work together. Here's all the notes I took from the Apple Intelligence portion of the keynote, so there's quite a bit more to cover still. Now, before I get into all of the Apple Intelligence stuff, keep in mind that it says it's coming in beta this fall, so very vague release schedule. We know we're probably six or seven months out from it. If we scroll all the way down to the bottom of this Apple Intelligence page here, we can see that the Apple Intelligence is compatible with these devices, iPhone 15 Pro and iPhone 15 Pro Max. So even if you have a regular iPhone 15, it's not going to work. You need the iPhone 15 Pro or Pro Max. Personally, I'm still on an iPhone 14 Pro. I bought this thing about a year and a half ago and it won't work on this phone. I'm going to need to get a new phone in order to use the iPhone. Apple Intelligence features if you're using an iPad, it needs to be one of the iPads that has the M1 chip or newer in it. And if you're using a MacBook Air or an Imac, you're going to want one that has the M1 chip or newer in it as well. So keep that in mind. The features are really cool, but most of the world is probably going to need to upgrade in order to actually use a lot of the features. So some of the things that the new Apple Intelligence will eventually be able to do will be things like taking actions on your behalf using natural language. So it will actually learn how to use some of these apps and actually take actions in the apps in the future, similar to what the things like the rabbit R1 and the humane AI pin promised to do now just built into your phone like everybody kind of thought was going to be the way anyway. It's going to have new image capabilities, which I'll get into in a minute. But one of the really cool things about the image capabilities is that it can actually learn what people look like and generate AI images of people in your contact list. It'll also be able to reference what's going on on your screen and various other apps that hold data on your phone to help you answer questions and to do things like scheduling and Be a bit more of like a AI personal assistant. They also stressed privacy. Throughout the entire presentation. They said that their AI is aware of your personal data without storing it. And they're going to do this by actually running most of the AI processes on the device, not actually sending it to the cloud. When there is a more processing, intense thing that it needs to do it, it will send it to a cloud. But they claim it's going to be encrypted at every point in the process. So even at the data center, nobody's going to be able to access whatever information you shared with the AI. The new Apple Intelligence operating systems are also going to have on device semantic search, meaning you can search however you want and whatever sort of wording you want, and it will understand the context of that search and then try to bring up the proper app or proper photo or proper text message or, or whatever it is you're looking for. So you'll be able to say things like, what time was I supposed to pick up my mom from the airport? It'll be able to look at your text messages and your calendar and maybe your emails and help you find that information across all of the various apps on your phone. And next up, they talked about Siri, which to me is funny that it took us this long to talk about Siri on an AI YouTube channel, because quite honestly, Siri has really sucked for a long time. But now Siri is getting this AI upgrade. It's going to have more contextual awareness around all of your apps, all of the data on your phone, text messages, emails, calendar, all of that. It's going to have that contextual awareness so that when you ask questions, it can answer those questions based on all of the information on your phone. It'll also be able to take actions for you in a much better way than it can now. So things like adding important things to your calendar or setting reminders or sending text messages are going to get a lot easier and much more intuitive with this new version of Siri. The new version of Siri is also fully trained on all of the Apple support documentation. So if you run into any sort of issues on your computer or on your iPhone or on your iPad, you'll be able to ask Siri. And Siri knows how to support itself now because it has all of the documentation trained into its model on device. They're also giving us access to GPT 4.0 directly inside of Siri. So they made a deal with OpenAI to integrate basically chat GPT directly into Siri. Now the way it's going to work is when you ask a question, it's going to basically decide whether or not it should just ask the on device AI. If it's a simple question or is related to some sort of contextual information that's already on your phone, it's just going to use that built in Apple AI. If it's a tougher question that needs a little bit more detail, needs a little bit more processing power, it will then ask permission and say, would you like to ask this to ChatGPT? It will then ask ChatGPT that question. So sometimes it'll use the on device AI, sometimes it'll use Apple's Cloud AI, sometimes it will use Chat GPT, but it always seems to let you know which one is going to be using so you can feel comfortable with the sort of privacy and what data is going where aspect of it. Siri is also getting the ability to type in your questions. So if you're in a crowded place and you don't want to sit there and speak back and forth with your phone, which often feels very awkward, you could just pull out your phone and type a question to Siri. And it will work the same way if you type the question to Siri as if you were to speak the question to Siri, which to me is weird that it took this long for them to do that because it didn't need any of this extra AI functionality in order to be able to do that feature. Siri is going to have the ability to take actions inside of notes. So for instance, if somebody sends you a photo related to a specific subject and, and you have a notes doc going on that subject, you can ask Siri, take that image that person just sent me and add it to my notes and Siri will just copy and paste that to your notes automatically for you. They also showed off examples of maybe you were on a meeting and it could listen to the meeting summary and send that meeting summary to an email for you. They call these app intents and these are actually going to be made available via the API. So developers who are developing apps on iPhone and Mac OS and the various Apple ecosystem are going to get access to add these features inside of their apps as well. There's a bunch of rewriting features, the types of features we already sort of use ChatGPT and Gemini and Jasper and some of these tools for directly on your device. You're going to be able to rewrite things that you've written. So maybe you've written an email to somebody, but you want that email worded a little more eloquently on device, AI will be able to reword that email for you. Maybe you want a document or email that somebody sent you summarized, you'll be able to summarize directly. On device. There's also a proofread feature where if you write something and you just want it to check the spelling and grammar and readability of it, it will proofread it and make suggested edits to make it just read better, but not rewrite the whole thing for you. That feature is going to work in all of the apps that have writing, even third party apps. Another thing that I thought was really cool that I think will be really useful is when you get an email, you usually see the from line, the subject line, and then like the first sentence from that email. Well, what Apple is going to start to do is instead of seeing that first sentence from the email, you're actually just going to get like a one sentence summary of what the email is about. So it's going to use AI summarize the email and give you that summary there. Same with your text message notifications. That will be really, really useful. If somebody sends you a text on your phone, you could look at the notification really quickly and instead of just seeing like the first couple sentences from the notification, you can, you'll see the summary of what the text is about so that you could decide whether it is important right now or not. They also showed off some image generation capabilities that are going to be rolled into pretty much all of the Apple devices, starting with a feature called genmoji, which is the ability to use AI to create any emoji you can possibly imagine. And one of the new iOS features that they announced was that the tap back feature, you know, the feature where you can click it and give it a thumbs up or a thumbs down or a haha or an exclamation. Well, now you'll be able to use any emoji you want on there, including the Gen Mojis that you generated with AI. They're also rolling out something they call the Image Playground, which lets you generate any image you want, similar to what you do with something like Dall E, except it's going to work directly inside of messages and Keynote and pages, and it's going to have its own dedicated app and developers are going to be able to add that to their apps using the API if they want. They're rolling out a feature called Image Wand where you can circle an image and have it improve the image with AI So if you hand sketch something and then circle it, it'll actually turn that hand sketch into a cleaner, better looking version of that image. They have a cleanup option where if you take a photo and there's somebody in the background of the photo that you don't want in there, you can tap on them and remove the people in the background. Using AI, you're going to be able to automatically record phone calls on your phone as well. And if you start a recording while on a call with somebody, it will notify them that that it's recording to sort of mitigate any privacy issues. But then after the call, you'll be able to summarize what you talked about because it'll have the entire transcript of the recording. And like I mentioned, GPT4O is going to be rolled out into the new version of Siri and you're going to be able to use it for free. And if you already pay for a paid version of Chat GPT, they're going to allow you to log in with that version and get the Premium features of ChatGPT also available inside of Siri. And finally, they mentioned this very, very briefly at the end, but I found it important to note is that they are going to be rolling out AI into Xcode as well. So if you're a developer who develops Apple apps, you're going to have a version of like GitHub copilot that works with Xcode. So AI will be able to help you develop apps directly for Apple as well. So my final thoughts on this keynote. I actually thought it was really, really cool. I think that a lot of the AI features they showed off will actually finally bring a lot of the features that us AI nerds have been playing around with for a long time into the mainstream. Right. I didn't really feel like there was anything announced that we haven't seen before. But that's kind of Apple's way, right? They kind of let other people break the ground on new technology and then when it's proven for these other companies, then they start rolling it into what they're doing. That's what we're seeing with AI here. There was really no feature that I was like, that's mind blowing. I've never seen anything like it before. We've pretty much seen most of the AI that they showed off in this event before, but because it's in an Apple product and because Apple has a reputation for privacy and for shipping what they say they're going to ship, when they said they're going to ship It I really think that this is going to bring much more mainstream adoption. People like my parents are going to be using these tools on their iPad and their iPhones where previously they're probably not going and downloading the ChatGPT apps or Midjourney and Discord or doing things like that. But now, because it's going to be directly in the apps that they're using every single day anyway, they're much more likely to start using these and integrate them into their daily workflows. I would say a lot of the sort of agentic features, the ones that sort of do tasks for you, they didn't show off much of that in the keynote. They basically said some of that stuff's coming, but we didn't really see what that looks like. So it's hard to say how much that's going to change our lives until we actually see it in practice and we see it being used. I feel like a bunch of the little features that they showed off, like copying one image and then putting it over into a notepad over here, like maybe saves you a total of three seconds. It doesn't feel like stuff that's going to save you hours out of your day. It feels like little tiny quality of life updates using AI that are going to save you a few minutes. I also think Apple is really playing it safe here, as they've been known to do. If you notice their AI image generator, it actually only generates in like cartoony styles. You have the option to do animated illustration and sketch, I think. So there's really no possibility of people creating like deep fake photos using these Apple apps. You're only going to create really cartoony stuff that isn't going to fool anybody. Most of the on device AI is for things like helping you find and manage apps on your phone, or maybe answering basic questions or doing math for you, things like that. But then if you want to do any sort of creative writing or get book summaries or things like that, it actually sends you to a third party. It sends you over to GPT4O. So Apple probably won't be, you know, liable if copyrighted work gets produced with the AI, because that's going to be the function that OpenAI performs for Apple instead of Apple actually performing it. So I feel like a lot of the plays they made are sort of very Apple plays and they're very safe bets. And they know people are concerned about privacy, they know people are concerned about where their data is going. So they made a big point to focus on the fact that Most of the AI is running on device so it's not sending anything to the cloud. And if it is going to send something to the cloud, it's going to let you know that it's sending it to the cloud and it's going to encrypt it. So even people that have access to that cloud aren't going to be able to read or access your information. Overall, I think Apple is going to change the game. I wish it was coming sooner. They said it's coming fall, which I guess is going to be roughly 6 months ish from now. So none of it we can actually play with today and when it is finally out we are ready to play with it. I'm going to have to go upgrade my phone to an iPhone 15 Pro or newer, as is anyone else who has a phone that's older than an iPhone 15 Pro. To the fact that we don't have access to a lot of it yet. We haven't actually seen a lot of the agent type features live in action yet and the fact that most people are probably going to have to upgrade to go and use this sort of puts a ceiling on my excitement around what Apple announced. But the fact that it is finally coming from Apple and it will kind of be in the hands of most general consumers pretty dang soon. That part excites me. That's my recap, that's my thoughts. I'm excited to finally get my hands on this stuff and play around with it and make videos and show what it's capable of and learn some new use cases for it and things like that. But it looks like we're going to be waiting for at least five, six months or so before any of us actually get to play around with it. But cool to see that Apple is finally in this AI game. I'm excited to see what they do with it. What are your thoughts on the Apple event? Leave a comment below, let me know. Was it just hype fest and nothing substantial that you're excited about? Are you pumped about this stuff? Let's start a discussion and let us know what you think about the Apple event and the new AI features that they're all rolling out over there. Thanks again for tuning in. I really really appreciate you. Check out FutureTools IE for all of the latest AI news and all of the coolest AI tools. Make sure you join the free newsletter. All keep you up to date with the most important news and the coolest tools directly in your inbox. It's totally free. We've got giveaways I also teach you how to make money with various AI strategies when you sign up for the newsletter. Lots of cool stuff there. Totally free. You can find it over at FutureTools IO. And thank you so much to HubSpot for sponsoring this video. I appreciate you guys as well. Thanks for tuning in. Really appreciate you. You like this video? Give it a thumbs up. Maybe consider subscribing to this channel for more AI news, tutorials and tool videos and and I will see you in the next video. Thanks again for tuning in. Bye Bye.