OpenAI SHOCKS Robotics World With "AGI" Autonomous Robot (Tesla Overtaken) (Sanctuary AI)

OpenAI partnered with Figure to build AI for humanoid robots, while Sanctuary AI's Phoenix robot completed tasks at near-human speed in a February demo. The moves signal major shifts in the robotics race beyond Tesla's Optimus.
Questions this video answers
March 1, 2024.
About 21 months ago (from the video's March 1, 2024 date).
Approximately 80 employees.
February 2024.
Peter Welinder, VP of Products and Partnerships at OpenAI: "We've always planned to come back to robotics, and we see a path with Figure to explore what humanoid robots can achieve when powered by highly capable multimodal models. We're blown away by Figure's progress to date, and we look forward to working together to open up new possibilities for how robots can help in everyday life."
Chapters
So there was a recent announcement that was actually surprising that continued to leave the industry shocked. And this one is actually a little bit shocking because of how crazy this is. And it was something that many people didn't see. Now I'm going to be covering two major announcements in this video, so make sure you stick around so you understand exactly what they are. So the first surprising announcement was the fact that OpenAI recently announced that OpenAI and humanoid robots, which we are collaborating with Figure Robot to expand our multimodal models to robotic perception, reasoning and interaction. So essentially they're combining their effort in AI with another humanoid robot company in order to bring together next generation AI models. And this is a huge announcement because this isn't just some like OpenAI investment, because previously there was essentially some news surrounding the OpenAI investment into the company, but they're actually doing a collaboration and that's very, very different. So there's. The discernment between these two is actually a very, very big thing because it now means that we are likely to get the next evolution in AI and robotics collaboration. So take a look at what OpenAI have said, because their statement that they just pretty much released like I think two or three hours ago is pretty interesting. So they said, okay. In conjunction with this Investment, Figure and OpenAI have entered into a collaboration agreement to develop next generation AI models for humanoid robots. Combining OpenAI's research with figure's deep understanding of robot hardware and software, this collaboration aims to help accelerate FIGURES commercial timeline by enhancing the capabilities of humanoid robots to process and reason from a language. That is pretty crazy because now they're in a collaboration agreement to develop the next generation AI models for humanoid robots. So I'm thinking that we're going to have to see what kind of systems are going to be developed with OpenAI, because OpenAI literally has the best talent in the game when it does come to developing AI models. And if you look at their track record, with what they've done recently with video, if you look at what they've done with music, if you look at what they've done with the course LLMs like GPT4, I have no doubt that this is going to be a really, really, really fruitful collaboration between Figure and OpenAI because they just simply have the best team and Figures robotics has been rapidly, rapidly, rapidly accelerating. So I'm going to read some more of the press statement and if you haven't seen Figures recent demo, this is their fully autonomous recent demo. And essentially the reason this is so crazy is because this company has Been moving, like I said before, very, very quickly. And the company started around 21 months ago, so that's just a little over a year and six months ago. And it's proving that they know what they're doing. They've got a lot of people from a lot of the top labs and they've managed to move at nearly not an exponential rate, obviously, but they're moving at with such pace that it shows that whatever's going on in their lab, they're doing things right because they're catching up to major players. Now, of course there are some other, you know, automated robots out there, but on the spectrum of real, you know, humanoid robotics, this is by far the one that does seem to be moving the quickest in terms of where they started to where they are now. Now why and the reason this actually shocked Tesla and other investors is I'm going to show you guys later on in the video because this announcement from OpenAI and another company that did a recent demo that most people didn't see is absolutely incredible. So if we take a look at this press release, you can see here that essentially they say in conjunction with this Investment, Figure and OpenAI have entered into a collaboration agreement to develop next generation AI models for humanoid robots. Combining OpenAI's research with figure's deep understanding of robotics hardware and software, the collaboration aims to help accelerate Figure's commercial timeline by enhancing the capabilities of humanoid robots and process and reason from language. So you can see here that we're getting that final collaboration between these models and you're thinking, how does this actually affect Tesla? Because you have to understand that they are developing the Optimus robot. But the Optimus robot, whilst it is really, really good, I'm pretty sure that this is a really, really surprising announcement. And there were also some other things that people were stating as well. People were stating that it's interesting to see the shift towards Figure. I guess no one is on Team Elon robots, but indeed the humanoid robots are coming and much sooner than what people expect because China wants to start mass producing them already in 2025. And someone responds, yeah, Figure's recent end to end demos were far more impressive than Tesla's teleoperated videos. And also a huge deal that OpenAI chose figure over anyone else. And this is coming from an investor in Tesla and of course not Figure. So that's why I posted the question, is Tesla losing this race Now? I think that question is obviously just playing devil's advocate. I don't think Tesla's actually going to lose this race. I don't think Elon Musk is to be underestimated, but I do think these other companies are showing how quickly they are moving, and it's definitely putting some pressure on the Tesla team to kind of speed up what they're doing. But if I'm being honest, they're already moving at a really, really great pace. And what we've seen from them since they started showing demos in around September 2022, I think they're just doing an absolutely amazing job. Now, essentially, what's crazy about this was that you can see that it says, this is a statement from OpenAI. That's why I wanted to make this video, because this is actually really cool. So they stated that we've always planned to come back to robotics, and we see a path with FIGURE to explore what humanoid robots can achieve when powered by highly capable multimodal models. We're blown away by figure's progress to date, and we look forward to working together to open up new possibilities for how robots can help in everyday life, said Peter Welinda, VP of Products and Partnerships at OpenAI. So you can clearly see that, like, either they're going to develop a new generative AI system. It might not even be generative AI. It's going to be some kind of AI system, know, completely autonomous, likely. And this AI system, whatever it's going to be, they are going to use this to, you know, in conjunction with the robotics, to make the very, very next generation of, you know, humanoid robotics much more efficient. And what's crazy is that, you know, this is OpenAI's expression in robotics. This is one of the ways that they're getting back into robotics. And of course, they said, we've always planned to come back to this. So this is why this is such a huge announcement. And of course, the bit that I've highlighted there, we're blown away by Figures progress today. And if you've been someone who's been paying attention, you can clearly understand why FIGURE have blown away absolutely everyone in terms of what they're doing. And, I mean, the CEO, he's been tweeting some stuff saying that we're really surprised by how much we're doing. And with every announcement, it just honestly does continue to actually shock me. So what's also crazy about FIGURE as well, is that the figure team, made up of top AI robotics experts from Boston Dynamics, Tesla, Google, DeepMind and Archer Aviation, has made remarkable progress in the past few months in the key areas of AI robot development, research, robot testing and commercialization And Figure recently announced its first commercial agreement with BMW Manufacturing to bring humanoids into automotive production. This new capital will be used strategically for scaling up AI training, robot manufacturing, expanding engineering headcount and advancing commercial deployment efforts. So essentially you can see here that they are working with some of the top labs or the robotics experts from some of the top labs like Boston Dynamics, Tesla and Google DeepMinds. So I'm guessing that some of the people like all these top companies. What I realized is that it's kind of like, and I know this is a pretty weird statement to say, it's kind of like if you watch soccer, if you watch NFL or if you watch, you know, the NBA, whatever, you know, your favorite sport may be. It's like the top talent is like, you know, trading teams and like they're getting loaned out and all these kind of, you know, it's kind of like a similar marketplace where like the top talent is really, really valued. And whatever, you know, organization they do go to, they do make an impact on how that company, whatever organization it's going to be, does go in the future. And I think showcasing the fact that, you know, they've got experts from Boston Dynamics, which is a really, really impressive company. Tesla, of course, another impressive company, and Google DeepMind and of course Arch Aviation. These companies are just some of the top labs. So we can expect this company to do great things. And we've already seen that as well. So it's going to be pretty crazy because they're going to be now, of course, scaling up AI training, robot manufacturing and they're going to be hiring a lot more people. Now, of course, what's crazy about this entire announcement, there's some more things that you do want to see because there's another robot that I have to show you that this is why, like, everyone was blown away. It says Figure will leverage Microsoft Azure for AI infrastructure training and storage. We're excited to collaborate with Figure and work towards accelerating AI breakthroughs. So essentially the entire thing they want to do is accelerate these breakthroughs. And that is something that we've seen happen quite a lot already. Now. There's also additionally something I do want to show you guys because it's pretty crazy. And it's the fact that this company has 80 employees and was founded 21 months ago. Like I said in the start, this is something that is absolutely insane. I mean, 21 months, that kind of progress is pretty incredible. So, I mean, that, ladies and gentlemen, isn't even probably the biggest announcement of this video because this announcement is pretty crazy. OpenAI saying, look, we're coming back to robotics. We're developing a new AI system that's going to be powered by whatever it's going to be powered by. We have no idea. But we do know that GPT5 and other systems may play a role in that. But essentially, the CEO has actually tweeted that, if it's not obvious yet, figures, humanoid robot is the ultimate deployment vector for AGI. So that is a clear statement on what they're building and where they're heading with this. So they, of course, want to embody AGI, which is really, really craz. And essentially, that actually just reminded me of something. Okay, this wasn't in the video, but I just got reminded of something that was tweeted about the other day, which is why this announcement is pretty crazy. So ChatGPT tweeted this. My body silicone, my spirit network. So I'm guessing that essentially this is like a vague tweet that could absolutely mean nothing. But I think it's kind of fascinating how they tweeted this on the same day of the announcement, because essentially, I mean, maybe it's a hint and a nod towards the fact that ChatGPT or GPT4, GPT5, whatever kind of version it is, is eventually going to be embodied in some kind of robot. And previously, the people who are working on the products at OpenAI have said the final version of ChatGPT will not be chat. So I'm guessing it's likely going to be an actual humanoid robot. And then that's going to bring about some big questions when it does come into the sentience argument. And all those kind of questions are going to be absolutely insane. So that's why it's going to be crazy. Now, something that you do want to know is, of course, the major, major announcement that kind of blew Tesla out of the water. So there was this one that actually did actually shock everyone, because this actually did shock me. And when you guys see this, you're gonna be like, whoa. I know. I did include this in another video, but I just wanted to do this entire video because the amount of robotics announcements that we are getting, I think they are very, very similar. Robotics and AI, they do complement each other a bit, but robotics is its own space that is moving very, very, very well. You can see right here, wow. Phoenix robot just overtook Tesla's Optimus. Phoenix is now autonomously completing tasks at human equivalent speed. This is an important step on the journey to follow autonomy. So the video that I'm about to show you showcases how quickly this robot is moving and why. This one actually did shock me, because while human speed is very, very hard to achieve, these guys have done it autonomously. And even if you look at some of the other top labs, you'll see that the autonomy part isn't actually there yet and the human speed part isn't actually there. But these guys have done both, which is quite surprising that we're getting this. So I'm actually kind of excited because I really do want to see what other tasks these robots are going to be able to do. And this is from the company Sanctuary AI. You can see that this is not sped up at all. This is 100% real time. It doesn't really look sped up. You can see control, autonomous, accelerated imitation, speed, task type, component sortation. And this is date February 2024. And you can see right here that this robot is sorting the stuff. I guess that one did kind of fall over there and maybe it should have, like, you know, fixed it. But it is pretty, pretty surprising at how quick it is able to do this. And this is not teleoperation, so there's no one behind this. But this short demo shows us that the speed and fluidity of these robots are going to be absolutely incredible once we do get them in scale. And, I mean, you can just begin to imagine what the future is going to look like if these things are completely autonomous, if it has an LLM embedded in it for its, you know, speaking capabilities, if it has a vision model, like a really good one, if it has like a, you know, huge long context window, and then if it's able to do these tasks autonomously, like with an AgileX system, I mean, what are we really going to be dealing with here? And the reason why this actually did, like, actually shock a lot of people when compared to Tesla's Optimus is because recently, if you were paying attention to the demo, basically Tesla Optimus, in one of their second or third demos, they actually talked about how, you know, Optimus is capable of accelerating its arms and legs, yada, yada, yada. But the thing that they were doing, which was one of the most remarkable things, was, you know, Optimus doing these tasks autonomously. Now, you might not have seen that, but if we just do this, I'm just going to go back to here. You can see that this is 1.5 times speed. Now, I do want to, you know, I'm not a Tesla hater, I'm not a fanboy of any particular company, but I do want to Say that of course it does say 1.5 speed, but in addition to that, this video is actually old. I think it's from 2023. So it is important that Tesla have made probably update since then. We don't know when they're going to demo them, but I just think it's quite shocking at how many other companies are in on this race and how they're also being able to do that effectively. So, I mean, Tesla's one here you can see it's neural net runs entirely on board, only using vision. And we can see it is also able to sort these blocks as well. And of course this is like an earlier version of their model. And of course it does also deal with the dynamic reality. So a question that I do want to pose for you guys is what do you think? Do you think Sanctuary's AI's robot is much more faster, much more fluid, much more efficient, or do you think the Tesla bot is the one that is going to win the race? Because of course we did actually just recently get a Tesla update and there was like this, I guess you could see small update to the robot in terms of the speed. So this is one time speed. This is really, really fast. And I guess you could argue that Tesla's robot, and I'm not sure why this thing was just glitching out there, but I guess you could argue that, you know, Tesla's overall probably going to be better because right now their robot is walking and we haven't seen the Sanctuary AI robot walk yet. But I find that this humanoid robotics race is going to be really, really interesting. Now what's also crazy about this entire thing is the fact that this isn't even the biggest announcement that is going to happen yet. And this one definitely did surprise me. And I really do love the design of the Tesla robot. I don't know why, I just think the design is pretty cool. But there is a really, really important thing, okay? Because, okay, big things are coming. Okay, Ted Zhao, someone that works at Google DeepMind's robotics area, they said there will be three to four massive news coming out in the next weeks that will ro the robotics and AI space. Adjust your timelines. It will be a crazy 2024. Now, I hope this post is true because, you know, sometimes people do state that, you know, tomorrow's announcements is going to be crazy and it's a really subtle one. I think this one is probably going to be big considering the fact that this account doesn't kind of tweet these things and say, oh, no, things are going to be crazy. So I think it's a very good chance that whatever is going to be announced is going to be crazy. And I guess these robotics companies that we're seeing are going to have another giant leap. So I'm guessing the next couple of weeks are going to be pretty crazy. And what's also crazy is that the other company that OpenAI invested, their other platform that they might be developing humanoid robots on is that, you know, someone stated that new progress update on the droids dropping in four weeks. So just one month looked like Moravec's paradox might be false and we just didn't have the data. And that's basically him saying that, look, things that we thought were difficult for robots but easy for humans might just be false. And now that we have some data, we're going to be showing you guys some really impressive demos. So that's going to be really surprising. And also there is this state of the humanoid robotics market thing. So if you want to actually pay attention. I'm not sure where this is from. I'm pretty sure there's tweet or I saw it on Reddit and I did see it on Twitter, but I'll leave a link to it if you do find it. Okay. It says compiled by, you know, at this. There we go. It's actually at the bottom right there, so you can just follow those people. But essentially it shows us how far all of these robots are. You can see them at the top. We've got figure AI. You can see that it's got LLM and voice integration, autonomous work, demo, doing useful work, walking publicly, showing hands. And of course we've got Tesla here, doesn't really have the voice integration yet, probably will and mounts pilot doesn't have it yet. But of course it goes to show that, you know, Agility Robotics, Sanctuary AI, all of these companies are slowly moving up there and it will be kind of interesting to see which of these robotics companies manages to do as well. Now if you're wondering as well, I forgot about this, if you're wondering as well who Sanctuary AI are, they're essentially an AI company that is creating general purpose AI robots. And their mission is actually to create robots that can actually understand the world the same way that humans do. And it involves developing AI that can perform a wide range of tasks. Essentially they focus on leveraging these technologies to address complex challenges across various industries. And their Phoenix general purpose robot, Phoenix stands out for its human like capabilities, including industry leading robotic hands with increased degrees of freedom 20 in total that actually rival human hand dexterity. And it is designed to work safely and efficiently alongside humans, either being directly piloted, operated with pilot assist or supervised while it's built in carbon AI system. So it actually does have an AI carbon system which I'm pretty sure they developed completely in house. And it's an autonomous control system that actually leverages a blend of symbolic and neural reasoning that and it's designed to observe, assess and act on tasks mimicking human cognitive functions. And this system allows for Phoenix robots to perform tasks autonomously or with human supervision, ensuring work is done safely, efficiently and sustainably. Now, essentially, the Sanctuary has, they also do have a world engine. Although it's not detailed in provided, you know, information on many websites. They do mention that training and piloting both the physical and virtual worlds suggests that they may offer a simulation platform and in which they train these robots in order to get to grips with the actual world. So this is a robot that is very, very advanced. They're moving very, very quickly. And the speed up fluidity of their recent demo definitely did actually shock a lot of people. So it will be interesting to see where this space kind of goes because now OpenAI are clearly stating that, look, we are now going to be doing this with humanoid robots. We're collaborating with this robot to expand our multimodal models. And I'm wondering if maybe these guys, you know, at first I was actually kind of thinking that maybe, you know, the One X Robotics, their, you know, Android, which looks to be really, really advanced, you know, just based on a few screenshots that we've seen. I'm wondering if these guys have hit a few hiccups because they were supposed to actually demo it last year and they just removed that from the web page, which I found to be, you know, not surprising considering how hard robotics is. And then now OpenAI is coming out publicly stating that, look, we're now going to be combining our efforts with figure I'm wondering not if they're giving up on One X, but if maybe they're shifting their attention to this company just based on how quickly they've moved in the short time that they've been there. And I know that Tesla is going to be giving another update very, very soon. So I wouldn't be surprised if that does improve as well. So with all that being said, let me know what you guys think about this new announcement. Do you think that Elon Musk is left stunned? Do you think that OpenAI has shocked the industry? Or do you think this is just your standard announcement. But either way, one thing that you need to be aware of and waiting for is the new announcements coming in a few weeks. And if you want to be aware, don't forget to subscribe to the channel so you can see all of that good stuff.










