AI SUNGLASSES?! Is Meta Onto Something?

Today was the Meta Connect event and there was some huge announcements at this event. The event was really, really focused around AI. Now, they talked about AI, they talked about the new Meta Quest 3, and they also talked about the new smart glasses that they created in collaboration with Ray Ban. Now, this video is going to be a little bit less polished than usual, but I wanted to give you a quick breakdown of all of the cool AI innovation and talk that came out of this event. And then towards the end, I'm going to talk about the quest a little bit. Just for those of you that are interested in that technology as well. I do know a lot of people tune into this channel specifically for the AI stuff, so. So if the quest and the mixed reality stuff that I'm going to talk about later doesn't interest you, that's why I'm putting it at the end. And one thing before I get into it, I just want to point out how cool it is that at the front row of this video I can see Colin and Samir, my favorite YouTubers, as well as a buddy of mine, Don Allen Stevenson iii, who I got to hang out with at the Artificial Conference last month. So really cool to see those people front and center in the audience there.

Let's talk about AI.

Let's talk about AI now. They started off the AI portion of this keynote talking about all of the stuff that they've released this year, as well as some of the stuff they've open source stu stuff like their text to speech translation, their image bind, their segment, anything, their audio tools and of course llama2. But the first real announcement was when they started talking about their AI image generation tool and we call it EMU.

For Expressive Media Universe. Continuing with our animal theme.

And here's some of the image generations they shared. Like a fairy sloth in a magical forest, a fairy cat in a rainbow forest, an astronaut underwater palm trees in a snowy landscape, and if dinosaurs were pets. And they also claim that these generations can be made in just five seconds. He then went on to talk about how this new EMU model is able to create AI generated stickers inside of chats. So platforms like WhatsApp and Facebook messenger, anything you can think of, you'll be able to create an AI sticker with it. For example, Hungarian sheepdog driving a 4x4, a capybara with a suitcase, a happy hedgehog on a motorcycle. You give it the prompt and it generates the AI sticker for you. And then you can use those stickers right inside of tools like WhatsApp in.

Addition to stickers, we're also bringing AI editing tools to Instagram next month.

With the AI image editing tool in Instagram might look like he had a picture of himself as a kid and he was able to put himself into various different outfits. He also showed off some examples with his dog where he was able to straighten the hair, do a cross stitch pattern, and here's his dog as Origami. Later on in the presentation, they actually talked a little bit more about how this works and gave some additional examples. So check this out.

We call them Backdrop and Restyle, and they're coming soon to Instagram in the us. With Restyle, you can create a new dimension of visual flair to your photos by just saying a simple word or phrase. You can now reimagine or create any filter that you can think of. If you feel like infusing, you know, a cozy vibe, you can type crochet. Or if you want to add a more artistic look, you can just type watercolor. And Restyle makes this really easy. And with Backdrop, it leverages one of our most popular model releases from this year. So segment anything and it can cut out any object in any image with just a single tap. So now you can reimagine your background and change the scene with just a few taps. I might type something like Surrounded by puppies, and this feature will give me an entirely new story for my photo.

So it looks like Instagram's gonna have some really, really cool AI generated effects in the near future that actually leverage Meta's Segment anything functionality. They also talked about different AIs for different things. They have their main AI, which they just call Meta AI. This is similar to what you'd expect from something like ChatGPT, but it's based on their Llama 2 model, where you could just have conversations with it about whatever you can think of. It's also going to be able to generate AI images from directly within the app. So, for example, on the screen they said, imagine a sailboat with infinite sails, and it drew the image. And here they're showing it off inside of Facebook messenger, inside of WhatsApp, and inside of Instagram Messenger. So pretty much all of Meta as various messaging apps this functionality is going to be added into. But here's where it gets really interesting. They're introducing a whole bunch of sort of niche chatbots, and they teamed up with celebrities to be the faces of these various chatbots. But they're sort of trained to talk about specific things. For example, they showed off Max here, who is a sous chef who can dish culinary tips and tricks. So a specific chatbot for getting help with recipes and meals and things like that. And here's Lily, your personal editor and writing partner. And Lorraine Reina, the world traveler, who would love to help you plan your next trip.

And then you have Victor, played by Dwyane Wade. And he's going to pull together a workout plan for you and get you motivated.

There's Dylan, the DIY craft expert. And in one of the best moments from the entire presentation, we got Dungeon Master Snoop. You can play an interactive game of Dungeons and Dragons directly with this AI Snoop Dogg.

Who hasn't wanted to play a text adventure game with Snoop Dogg? We've got Voice coming over the couple of months, probably, probably early next year or something like that.

Some of the other niche chat bots that they talked about rolling out are Bob the Robot, who's a snarky robot who can help up your academic game. You've got Brew, played by Tom Brady, who's your sports niche chatbot. Naomi Osaka, the manga master. Chris Paul is the golf guru. Harris Hilton is apparently the detective. Mr. Beast plays Zach the funny man.

I'm not saying I know everything.

And we've got Izzy Adesanya playing Louise, the MMA maestro. Kendall Jenner as Billy the big sis. Roy Choi as Max, the king of the kitchen. Charlie d', Amelio Coco the dance queen, and of course, Snoop Dogg, the dungeon master. Now, although they have all of these AI chatbots designed for specific niches, they're also planning on allowing you to train your own chatbot based on you, so you can train it on your unique interest and expertise.

So we've been creating something that we call AI Studio. It is a platform for building these kind of AIs. And we're starting by opening up the API for integrating into our messaging apps to start, and that's going to open in the coming weeks. We are also building a sandbox so that, you know, people who don't code can also train AIs like this. And we're working on that and iterating on it, and we hope to have that out sometime early next year. And we're also working on bringing all of this to the Metaverse too, where you're going to be able to have these embodied. These AIs will be able to be embodied as avatars.

This is cool.

You'll be able to make them as NPCs in the different games and experiences that you build.

And all this is so wild. Basically, what he's saying is that you're going to be able to train an AI on yourself that thinks like you, talks like you, acts like you, because it's trained on whatever data you trained it on. And then that character could live in the metaverse and, and people can have conversations with you in the metaverse even when you're not around, because AI you will be representing you in the metaverse. Crazy.

I think that that's going to be really neat.

And then he went on to talk about how businesses can use these chatbots as well train them on their own products and services. That way customers can get customer support from the AI chatbot that's trained on your sort of knowledge base from your company, which is obviously another huge use case for these fine tuned, custom trained AIs that they're working on. Then after all of that, they got into their collabor between meta and Ray ban to make these smart glasses.

Last thing that I want to show you today, which is the next generation of Ray Ban meta smart glasses. Now these are designed, obviously you can stay in the moment and stay connected without having to take your phone out. You can capture what's going on around you, you can share with your friends in the world. Everything about this is upgraded from the first version.

So the quick breakdown of these is that they're glasses that you can wear. They can be sunglasses, they can be prescription glasses, they can change out the lens. However you. There's really nothing special about the lens themselves. There's no like heads up display or anything like that in the lenses. Although Zuck did say at one point that that is sort of where they're hoping to get these at some point is to have that sort of heads up display inside of the glasses. But these ones are really a built in camera, so they have a 12 megapixel camera so you can walk around and record from your point of view. They have really good speakers built into them that theoretically really only you should be able to hear because the way the sunglasses wrap around your ear, it sort of directs the sound straight to you and ideally nobod around, you can hear it. Now I do know some people that have the last version of the sunglasses and if you are close enough to them, you can hear them. So it'll be interesting to see if these new ones are improved over that. They also announced that with this version you'll be able to live stream directly from the glasses. So you can go live on Instagram or Facebook and live stream your perspective on anything. So all of that is cool. And I'M excited to have that functionality. I'm probably going to get a pair of these Ray Bans. I can see them helping when I'm filming and I'm at events like this to wear these glasses and get little snippets during the event. But here's where the AI comes into play and what makes these quite a bit more exciting than the last iteration of them.

These are the first smart glasses that are built and shipping with meta AI in them. So starting in the US you're going to get this state of the art AI that you can interact with hands free, wherever you go. You know, let's say you're grilling with your family and you want to know how long you need to be cooking that chicken for, you know, or you're playing pickleball and hits the line and you want to know if that's a fault. Or let's say you just want to settle a debate, you know, some trivia as you're going out through the world. Just ask your Ray Ban meta glasses and they'll respond and get you the answer.

So that, to me is really cool. You know, right now we've got AI in our pocket. You've got the ChatGPT app, you've got the Perplexity app, you've got, you know, whatever chatbot you like to use in your pocket with your phone. But now if you have a pair of these glasses, you'll just have it right there available to you, where in any moment you could just ask it a question and it will respond. Now, he also talked about how there's going to be an update to these glasses in the future. So if you buy these glasses in the future, you will get this update rolled out into your glasses.

Starting next year, we're going to be issuing a free software update to the glasses that makes them multimodal. So the glasses are going to be able to understand what you're looking at when you ask them questions. So if you want to know what the building is that you're standing in front of, or if you want to translate a sign that's in front of you to know what it's saying. If you need help fixing this sad leaky faucet, you can basically just talk to meta AI and look at it and it'll walk you through it step by step. How to do it.

The glasses they're launching October 17th. You can actually pre order them now for 299. And personally, I'm pretty excited about the functionality on these. Now. I'm going to Talk about the meta quest 3 in a second here and talk about some of what they announced at that. Before I do, I just kind of want to give some of my thoughts about this event overall. I think that this event that Meta put on today was sort of a catalyst for mainstream adoption of a lot of this AI technology. If you're already using Facebook messenger or Instagram messenger or WhatsApp, all of a sudden you're going to have AI image generation and AI chat and various niche chatbots just available to you in these tools that so much of the world is already using. And when it's just there and available, you don't have to go to some other third party website, you don't have to go to ChatGPT's website, you don't need $20 a month pro membership for it. There's no real roadblocks because it's just in the apps that you're already using. I feel like the adoption of all of this tech is just going to skyrocket. I also think what Meta is doing here with these Ray Ban glasses is slowly getting the general public to get more and more comfortable with a thought of wearable technology. And their end goal is obviously more augmented reality sunglasses. At this keynote, they did talk about having heads up display, they did talk about these glasses becoming multimodal and actually seeing what you're seeing and understanding what you're seeing to give responses. It's only a matter of time before we get augmented reality glasses in this same sort of form factor. And I think if a company like Meta tried to go too quick and put too much of this stuff in a pair of glasses like this, it sort of freaks people out. That's kind of what Google Glass did where it just had all of this cool tech in it. But they looked goofy and people were sort of put off by all of the tech that was in these glasses. But if they slowly introduce new little pieces of tech into the glass, little by little, next thing we know. These are some of the most advanced pieces of technology we all have on our body and it just kind of happened gradually. That's where I kind of see this going. They're sort of training us to get used to this wearable tech and I'm excited about it. I have virtual reality goggles, I have the mixed reality stuff. I'm going to get a pair of these and test them out and see what I think of them. And these are just one step closer to everybody having AI at their disposal at, at any moment. Yes, I could reach into my pocket, pull out my phone, open one of these other AI apps. But with this now, I'm starting to get used to just talking to AI whenever I need help with anything, without even pulling out my phone, basically saying, hey, Meta, my glasses fire up. I can ask it any question I want. It can see what's going on around me to get more context about the question that I'm asking, and then it gives me the response. Our brains are already sort of augmented with the smartphones we have in our pocket. We essentially have a second brain where we can get access to any information we want by reaching into our pocket, pulling out the phone, typing in a query, and then looking at the phone to get a response. Or in some cases, you know, talking to our phone and getting the response that way. This even eliminates one step. I know it saves just a few seconds, but those few seconds are probably going to make a big impact for how often people actually use this AI technology. So when this technology all gets released and we get our hands on it, I think it's going to be a pivotal moment for the world of AI and for this wearable mixed reality technology that's starting to roll out at a more rapid pace. We have Apple Vision Pro coming next year. All right, so let's talk about Oculus 3 quickly. I'm not going to go too deep into this, but it does have some cool features. It's not really AI focused, but I did want to talk about it because I love mixed reality stuff as well.

Mixed reality allows you to bring digital objects into the physical world.

Now, the biggest upgrade to this technology over the meta quest 2 and the meta Quest Pro is this pass through technology where you can see your environment around you. Now, that does exist in the Meta Quest Pro, but if you are a Meta Quest Pro, it's very pixely and it doesn't look very good. It looks like a very low quality video of the room that you're in. You don't actually feel immersed in the room that you're literally sitting in. You feel like you're watching a sort of pixely video of the room you're sitting in. It seems like that's solved with the meta quest 3, where the environment around you looks much cleaner, less pixely, and feels more like you're actually still in that environment. They showed off examples of people playing games. This is like a Lego game that somebody is able to play and that is their actual room around them. It's just superimposing the game onto their coffee table. Same with this there you can actually see the room around the people, but it's superimposing the game into the environment that they're actually in. It also knows the shape of your room. He made a comment about how you can actually throw a digital ball against the wall. It will know when it hits the wall and that digital ball will bounce back at you. You can be playing a shooter game and you can jump and hide behind your couch and hide from the shots that are firing at you. You're going to be able to watch things like Instagram reels with your environment still around you. They'll just see it kind of right in front of your face, but you'll still be totally aware of everything that's happening around you. You can superimpose pictures and videos on your walls. The chip that's in it is the Snapdragon XR2 Gen 2, which is a much upgraded chip over all of the previous Meta Quests that have come out. They've got some new lenses, so it's going to be a lot more high definition, a lot easier on the eyes. And there's a whole bunch of cool games that are going to be coming out for the Quest 3, like this Wrath 2, which is a game that actually comes with the Quest 3 if you purchase it. There's Assassin's Creed Nexus, which is an Assassin's Creed game in virtual reality. And this was something that I thought was super cool. You can basically sit like courtsite at a real live basketball game in virtual reality. Like you're actually there at the game. That, to me, is really exciting. I'm not a huge basketball fan, but I definitely want to try that. Some other cool things that they mentioned about this at the event, they're teaming up with Microsoft to make Xbox Games event on the Meta Quest 3. And also the Microsoft Office suite of tools like Microsoft Word, Microsoft Excel and PowerPoint are all going to be available on the Meta Quest, which really shows that Meta and Microsoft really are kind of partnering up on a lot of stuff, because as we heard from Microsoft, Microsoft is not only working with OpenAI and ChatGPT, but they're also working with Meta and the Llama 2 model. But it looks like as part of their growing partnership now, Meta is actually going to integrate a lot of Microsoft's tools and gaming platforms into their hardware as well. So that's really interesting to see. It feels like Meta and Microsoft are almost like teaming up together to sort of take on Google and Apple. So there you have it. There's my breakdown of meta connect 2023 some huge AI announcements. I think they're going to be some pivotal announcements that are going to push the mainstream adoption of AI forward by leaps and bounds. Push the mainstream adoption of this sort of wearable, almost augmented reality technology forward by leaps and bounds as well. So really, really exciting news. I know this video is not as polished as my normal videos, but there was so much news from Meta today that if I tried to work all of this into my upcoming end of week news video, the whole video would probably be dominated by Meta. So I figured might as well just make a dedicated standalone video about today's Meta announcements. That way, when I make the news video at the end of this week, I can refer you to this video and then just quickly, briefly touch on all of Meta's announcements in the so hopefully you enjoyed this. Hopefully I saved a couple hours out of your life from tuning into the whole event. It's still a pretty cool event if you want to watch the whole thing, but I pretty much broke down everything they said in this video for you and I tried to do it as quickly as possible. So hopefully this was helpful. And if you did like this video, make sure you give it a thumbs up. And if you haven't already, subscribe to this channel because that makes me feel good. And finally, check out FutureTools IE where I keep the AI news up to date every day. I share all the latest cool AI tools that are coming out and I've got a simple twice a week newsletter where once a week I'm gonna send you all the latest AI going on. And once a week I'm going to send you all the coolest AI tools that I've come across. They're super quick to read emails. They come out Wednesdays and Fridays. I promise I won't clutter your inbox. Just those two emails a week with the AI news and the AI tools. You can find it all over at FutureTools IO. So thanks once again for tuning into this video. Hopefully you found it helpful. I really, really appreciate you. The AI world is really ramping up. The hype is getting extreme again like it was several months ago. I'm excited. I've got a lot more videos. It's getting back to this point where I can't even put out videos at the pace that I have the ideas for the videos. So loving this AI space right now, loving the tech space right now and so appreciative that people like you tune into these videos and nerd out with me. So thanks again for tuning in. Appreciate you. See you in the next video. Bye bye.

It.