OpenAI's NEW "VOICE ENGINE" Project Is STUNNING! (Open AI Voice Engine Explained)

So there is a new project that OpenAI are allegedly working on. And in this video I'll give you guys all the details you need to know to stay update with OpenAI's new voice engine project that they seem to be working on in rather secrecy. So let's take a look at exactly what all the details are so you can stay up to date. So one of the first things that we noticed and one of the first pieces of information that led us to this discovery is of course the trademark. Now many people have speculated about trademarks before, myself included, but of course trademarks do include a little bit of speculation. But later on in the video I'll show you guys a lot more evidence that leads me to believe that this is a real thing coming very, very soon. And once you see all of the information, you're truly going to understand why this is very likely going to be a project coming in the future. So we can see that they trademarked Sora before, and then the day after that they did release the Sora announcement. They announced their text to video thing. And then of course you can see right now, very recently on the 19th of March, they actually trademarked Voice Engine. And this has a very, very interesting description. And of course by the name Voice Engine, we do know that it does mean something to do with the voice. I'll get into the description of exactly what it covers in a moment, but the point is, is that this trademark was filed recently. Now the only problem with this trademark being filed recently and not being released is that we don't know ex when this is going to release. However, we do know that a product is going to be coming later this year because Sam Altman in a recent interview did actually say that later on this year they're going to be releasing a bunch of different products and they don't know what they're going to be calling them. I'm guessing right now we do know that one of those products is going to be called Voice Engine as it was recently trademarked and it could be here within the next month, within the next few months. But we do know that this is going to be coming out this year and the description of this is very, very interesting. So let's get into the actual description of this trademark and what it possibly means for future products. So if we actually take a look at the trademark description, we can see here that voice and speech recognition, processing commands and converting between text and speech, there are a bunch of different things here that go to show that this is going to likely be some kind of voice integration software that either uses our voice to direct an AI system what to do, or we can use it to generate lifelike speech. And there's many different things here, as you can see, automatic speech and voice recognition and generation. And then, of course, we can see building digital voice assistants, which is one of the main things. Now, I'm going to be coming back to this page because there's actually a lot to dive into, but I want to give you guys some more information with us to why I think this project is going to be coming very, very, very, very soon. So, as you can see, all of this is audio voice generation. And of course, it also does include some speech recognition. But there's some key pieces of information that OpenAI employees have actually tweeted about that gives us a further insight. The first piece of information that many people may not have been aware of is this from Andrej Karpathy. So Andrej Karpathy used to work at OpenAI. The screenshot you're currently looking at is, is actually an old screenshot, but I've done that for the purpose of showing you guys his bio. In his bio, you can see right here that it says, building a kind of Jarvis at OpenAI. Now, essentially the reason that that is such a hint onto this project is because this was, I think a year ago or a couple of months ago that this was his bio. But obviously since he no Longer works at OpenAI, that's why I'm taking a look at the old screenshot, because it has this piece of information. Now, if you don't know what JARVIS is, you might be confused with as to. I even read out that statement. Jarvis is actually something from the Iron man movie. It's essentially a AI assistant that is pretty much an AGI level system, artificial general intelligence level system, that is really, really, really smart. And Tony Stark, the main character in the movie, all he does is he uses voice commands to control his AI system and he uses it to control his house, he uses it to control his suit, and he pretty much uses it for absolutely everything. And it is really, really, really, really smart. So when someone who works at OpenAI and says that they are building a kind of Jarvis at OpenAI, this kind of gives us to the insight on what kind of products we might be getting. Now, I can't include any Iron man clips here, but you can think of it like a kind of version of Siri, but just 10 times better. That can pretty much do anything you could ever think of in terms of data analysis, in terms of, you know, controlling your entire house. And of course, if you did own an Iron man suit, it could control that as well. So this is the first piece of information that I'm sure most would have missed because his bio has changed and of course, he doesn't work at OpenAI anymore. Now, there was also another piece of information that I did find on Reddit. Now, someone who previously worked at Google did also state that OpenAI will release this year the best personal assistant ever built. Nothing will compare to this thing. It will make Jarvis, Samantha, Hal look like something from the past. And those are all fictional AI voice assistants. And it says a good function calling model is all they need, and by now they're. They seem to have one. So essentially what this person is saying here, and we do have to be skeptical about this tweet, however, it does tie into pretty much everything we've seen so far, is that maybe this person has some kind of insider information, because when they did tweet this out, this was far before the trademark and far before the rumors started to circulate, which means that potentially this person does know something more than we do. So what they're basically saying is that this is going to be a personal assistant that will be the best thing ever built and that nothing is going to compare to this thing at all. Which does mean that even if we do get some kind of personal assistant from OpenAI, it means that potentially the kind of system we're looking at is going to be more advanced than Jarvis, Samantha and Hal, more advanced than Siri, more advanced on those home devices we have. And it seems like we can't even begin to conceptualize what OpenAI is working on now. I think it's just going to be some kind of superpowered assistant. But I do think that it is going to be very, very fascinating to see how they integrate this into the rest of the ChatGPT stack and how this kind of thing does work. So this definitely does get me pretty excited. And there's even more information that you guys haven't seen yet that's going to get you guys super pumped, because there is a lot more information from OpenAI employees that they have actually said about this very, very thing. So even if we are skeptical of this tweet and we're like, okay, maybe this person is just building hype or whatever, let's say we're skeptical about this tweet, I'm actually not skeptical. I actually leave this statement. We can take a look at something that I worked on earlier this year. So earlier this year I made a video and I think it was around a month or two ago and I spoke about this person right here. Okay, so this is a screenshot from an article on the website called the Information. And it said last month, Ben Newhouse, an OpenAI employee who worked on computer agents using agents at the startup, according to a person familiar with his role, posted on X that he was hiring for his team and building what I think could be an industry defining zero to one product that leverages the latest and greatest from our upcoming models. He didn't elaborate and of course someone else said that it would change everything. So essentially two OpenAI employees tweeted this. And at the time I did think that this was to do with agents. But what we could be seeing here is that this could be something that combines AI agents with voice generation or something along those lines. So imagine voice generation along the lines of Siri. So a personal assistant, which is like a complete AI agent that you get along with some incredible, incredible voice software. Now the reason that I think this is going to be true is because if we take a look at what AI agents are, AI agents are essentially autonomous personal assistants that do things on your behalf. We haven't really seen one that is really, really good yet. We've seen some in the media, like the rabbits one we've seen recently that there was literally Open Interpreter just released. We've seen Humane's AI pin, but. But apparently this is going to be even better. And considering OpenAI's history of building great products, this seems to be something that I'm really, really excited about. Now you can see that this article isn't just completely fabricated. You can see that this person said, Ben newhouse, I'm hiring OpenAI. We are building what I think could be an industry defining zero to one product that leverages the greatest from our upcoming models. And if you like product deep technical challenges, my DMs are open. So this person here of course is showing us that what they are building. And this was Tweeted earlier this January 25, 2024. I did actually retweet this. I did think it was about agents and I don't think I'm wrong. I do think that this is going to be something that combines agents, combines the lifelike and human like nature from the systems and then possibly releases it in a very fascinating way that possibly helps us to do a lot of household tasks or a lot of annoying things like checking our emails and responding to them. Now what you can also see here is this is the additional tweet. This is Peter Walinda, the VP of Product at OpenAI and he says that this product will change everything. So him, quote, tweeting that and stating that this product will change everything means that this product is likely to be a very, very tremendous change in terms of what we are used to. Because whilst voice assistants are quite good, I do think that there is a lot of room for things to change. We saw how viral Rabbit went and how viral Humane's AI pin went. So potentially one of the things that I'm leaning into is the fact that OpenAI might actually be leaning into a physical product. Now, I don't know if that is going to be the case, but we do know that that is a possibility. I'm leaning more towards the side that they're not going to do this because I think that OpenAI is by default just like a software company and they mainly just like to focus on software. But that doesn't mean that they can't do this because OpenAI has already had talks with some people at Apple to build some kind of product. And we do know that, that this is something that many companies have already gone to market with and I've already ordered a few products and I really cannot wait for them to arrive. Currently, if you're wondering what on earth am I looking at, this is essentially Alexa and this is basically Amazon's AI device where you can speak to the AI that is Alexa and you can control your home, you can control your devices. It's something that is really, really cool. But the reason I say a physical product is because what people often like to do is if they have something like an Amazon Alexa or like a speaker which they speak into, they just like to yell command, have it recognize them and then obviously be able to complete commands on that complete task. And I think that since OpenAI does have its whisper software, which is basically automatic speech recognition and it's the very, very best in the game, I would not be surprised if they released some kind of small product. Now, the reason I said that they might release a product in the future is because products do take quite a long time to get down if they are really, really well. And it does take a long time if you're trying to get things really, really perfect. And considering OpenAI' I think they have a kind of Apple esque approach to making things more perfect than they originally need to be. And I think that that tip will take a little bit longer than we may initially think. Now I do think that they might just release some really, really cool software first. Because what they could do is they could just release the voice kind of software. And I think that one of the features that is going to be really cool is the human, like, nature of the speech. Now many people didn't actually pay attention to this, but if we actually go back and we look at this video right here, the voices on this, and if you're not sure what this is, this is figure one. Essentially this was the robot that was using OpenAI software. And this actually sounded really, really, really good. Okay, I think I'm going to play a small part of the clip, but when you guys hear it, you're going to be like, whoa. Okay, that was really, really, really good on it.

So I gave you the Apple because it's the only edible item I could provide you with from the table. I think I did pretty well. The Apple found its new owner, the trash is gone, and the tableware is right where it belongs.

I agree. Thanks. Figure 1. So I think that goes to show us, and considering that this is utilizing on the backend, OpenAI's technology, that in the future, whatever kind of voice software we're going to get, it's going to sound rather remarkably super, super realistic. And we already know that that is being done by eleven Labs. If you aren't familiar with eleven Labs, it's an AI software that allows you to not only clone your voice, but clone other people's voices. And it allows you to create custom human sounding realistic voices from simple text prompts. And I've titled this Coming for the full stack because I do believe that right now, if you are a company that is in AI, I think that OpenAI is pretty much coming for every single company that is out there with regards to anything related to artificial intelligence along one of the big five main, I guess you could say systems. So for example, text, image, video and audio. I think OpenAI is truly trying to just be state of the art in all of these. I don't think they just want lms, I think they want agents, I think they want audio and I think they want video. And considering how realistic their previous voice sounded, that is something that is not surprising. Now, something that is actually also really, really fascinating was that there was a recent trend on Twitter after the demo of Figure. So after the demo of Figure, people started to realize that, look, this thing sounds super, super realistic. And what they started to do was they started to use the ChatGPT app. So for example, if we go to the ChatGPT app like Siri and Let's say, for example, I just start to say, so are you guys going to listen to this live? This is a live demo. And I'm going to say, hey, ChatGPT, can you give me a marketing plan for a YouTube channel that is about AI? But I want you to make your response sound as human as possible. So please use ums and ahs and filler words so that you sound as realistic as possible. And then once it gives me my response, it sounds very, very realistic.

Timely with how fast tech is moving these days. All right, first things first. You want to define your target audience, right? Are they like tech enthusiasts, students, professionals? Knowing this helps a ton with tailoring your content. Now, for the content itself, you're going to want to mix it up a bit, maybe throw in some tutorials, deep dives into AI news, interviews with, you know, experts in the field, and oh, don't forget, share snippets or like teasers of your videos on, let's say Twitter, LinkedIn or even Instagram to, you know, draw more viewers in. And I guess collaboration is pretty huge on YouTube. Maybe reach out to other content creators for, you know, guest appearances or co hosted videos. It's a great way to get exposed to each other's audiences. Lastly, SEO, make sure to optimize your video titles, descriptions and tags with relevant keywords. It helps a ton with getting your videos to show up in searches. So, yeah, I think that's kind of the gist of it. Just keep your content fresh, engage with your audience and use all the tools at your disposal to spread the word. And mistakes are totally okay. They make you seem more relatable. You know, just keep at it and you'll find your groove.

So right there you heard just how crazy OpenAI's like standard, state of the art, you know, voice thing is. So that's what it sounds like now. So that's them just giving out their very, very basic voice kind of software. So that's why, and I actually, you know, was quite surprised there because it sounded super, super realistic. And I think that that goes to show how crazy in the future the kind of product will sound and how insane this product could be. So either one, we could be getting some kind of physical product and I think OpenAI might opt for this route. And I say might because, number one, they don't want other competitors to surpass them. But number two, if they do a physical product, they could like, sell out really, really, really. Like, if they sell out a lot, they could become a really, really profitable company because let's say these price, did they price these devices at some kind of premium product? And let's say it works with all of ChatGPT stuff. They could become like a really, really big company. I'm talking about like, you know, $500 billion, a trillion dollars. Just like Apple because Apple literally makes so much money off of its hardware and off of its branding, off of its, you know, entire stack where it's able to just rack in the profits because it's such a profitable company in terms of the way it markets its products and in terms of the fact that it leaded the way in terms of the kind of style that it did. And I think if OpenAI does go down the physical product route and if they do, you know, decide to sell consumer products, I think that would be a huge, huge thing for them because they already have the wide brand range. It was the fastest consumer, you know, product to grow, the fastest social media kind of thing. And I think that that would be something crazy in the future. Now I don't think they will do this now, but I think they will do this in the future and they have talked about this already. For those of you who don't think this is a reality, you can see that here Bloomberg actually reported on Apple's iPhone. Design chief enlisted by Jony I've Sam Altman to work on AI devices so you can see that they are joining OpenAI to work on AI devices. And it says here that legendary designer Jony I've and Sam Altman are enlisting an Apple Inc. Veteran to work on a new artificial intelligence hardware product aiming to create devices with the latest capabilities. At a part of the effort, outgoing Apple executive Tang Tan will join I've's design firm Loveform which will shape and look the capabilities of new products according to people familiar with the matter. Altman, an executive has become the face of modern AI plans to provide the software underpinnings and said the people who asked not to be identifies because the. So we can see here that it seems very likely that, you know, since OpenAI is recruiting people to work on a physical product to design some kind of AI device that this is not out of the picture. We could be getting some kind of, you know, device in the future or the first thing that we could be getting is some kind of major voice update. Now I'm not sure if this is going to be similar to the Google Home, similar to the Amazon Alexa, but either way this trademark does give us further insights. Okay. Into the fact that OpenAI is going to be releasing something later on this year. And the fact that, you know, Andrej Karpathy said building a kind of Jarvis or OpenAI, the fact that, you know, some of the OpenAI employees have said that, you know, this is going to make certain other things obsolete, it's going to absolutely change everything. You know, the VP of products saying that this product will literally change everything is pretty, pretty crazy when you think about it. So I think that right now we are in a very, very interesting thing. And I think if we also look at the capabilities of multilingual speech recognition, translation, transcription, generation of audio, you know, basically a digital voice assistant, I think this is going to be absolutely incredible. Let me know what you think about this. Do you think this is just a rumor? I think that this is going to be the next big thing. It might be the biggest product of 2024, considering how far behind Siri and Amazon actually are, since they haven't actually updated their systems. I have no idea why they haven't just yet. They literally could be doing incredible things. But I guess some companies are asleep at the wheel, and I guess we're going to have to wait to see exactly what happens with this technology that.