OpenAI Is FALLING Apart. (Ilya Sutskever Leaving, Super alignment Solved? Superintelligence)

So I'm just gonna get straight into this video because there's no point in wasting time. I think certain parts of OpenAI are truly starting to fall apart and this video might be a long one, but trust me, every single slide has been carefully created so that you guys can understand all of the information and how. You can see here that one of the main things that we got today was the news of ilya Satskova and OpenAI. This was something that a lot of people were actually waiting on because we hadn't heard from Ilya pretty much since November. And. And even in recent interviews, Sam Altman consistently refused to speak upon what Ilya's status was @OpenAI. But we finally have the news. He says that Ilya and OpenAI are going to part ways. This was very sad to me. Ilya is easily one of the greatest minds of our generation, a guiding light of our field and a dear friend. His brilliance and vision are well known. His warmth and compassion are less well known, but no less important. OpenAI would not be what it is today without him, although he has something personally meaningful he is going to work on. I am forever grateful for what he did here and committed to finishing the mission we started together. I am happy that for so long I got to be close to such a genuinely remarkable genius and someone so focused on getting the best future for humanity. Jakob is going to be our new Chief scientist. Jakob is easily one of the greatest minds of our generation and I'm thrilled he's taking the baton here. He has run many of our most important projects and I'm very confident he will lead us to make rapid and safe progress towards our mission of ensuring that AGI benefits everyone. So that statement there clearly shows that Ilya Satskova is no longer working at OpenAI and is going to be working on something else. And this is something that at least we can say now we have some kind of closure on where one of the greatest minds in AI, where they are going to be now. One of the things I did want to know is I wanted to know that who is going to be replacing ilya Satskova at OpenAI, and that is of course, Jakob. Now, essentially, if we look at who Jakob is, Jakob is now the Chief Scientist at OpenAI where he has led transformative research initiatives since 2017. He has previously served as Director of Research, spearheading the development of GPT4 and OpenAI5 and fundamental research in large scale reinforcement learning and deep learning optimization. He has been instrumental in refocusing the company's vision towards scaling deep learning system and Jack upholds a PhD in theoretical computer Science from Carnegie Mellon University. So clearly this is someone with a very, very impressive resume and clearly has all of the necessary skills to take on the AI niche. Now as for Elya Satskova, something that I know many people have been wondering it is what did he say? And he posted this tweet after quite some time. He said, after almost a decade I have made the decision to leave OpenAI. The company's trajectory has been nothing short of miraculous and I'm confident that OpenAI will build AGI that is both safe and beneficial under the leadership of Sam Altman, Greg Brockman, Mira Moratti, and now under the excellent research leadership of Jakob. It was an honor and a privilege to have worked together and I will miss everyone dearly. So long and thanks for everything. I am excited for what comes next, a project that is very personally meaningful to me, about which I shall share details in due time. So clearly Ilya seems to have left on good terms despite the entire tumultuous period that was the firing of Sam Altman. But I think one of the most interesting things that most people are looking forward to now is of course, what comes next. So it says that he is excited for what comes next and it's a project that's very personally meaningful to me, about which I will share details in due time. So whatever Ilya Satskova is going to do next, I'm guessing that we will receive an update. I guess maybe a few weeks, could be a few months, I have no idea. But it seems that we're going to be getting an update sometime in the near future. Now, essentially there was also this peach Whilst things on the surface might look like OpenAI is completely fine, so the following slides that I'm about to show you do showcase an entirely different picture because OpenAI has been losing key members of their most important team in regards to AI safety. And I'm about to break this all down for you because when I started to do the research on this, I was like, wow, things are starting to look a little bit pessimistic in terms of AI safety. Now, Ilya also did tweet this picture with the rest of the OpenAI team, but I do remember that during December there were some tweets by Ilya Sutskever where there were some tweets that were vaguely worded in a way that kind of implied that OpenAI was in a toxic work environment. He said that I learned many lessons this past month. One such lesson is that the phrase the beatings will continue until morale improves applies more than it has any right to. And this, of course, could be just dubious speculation with regards to what he was talking about. But. But during the time that this was tweeted, it could be argued that it was only related to one key event. And that, of course, was OpenAI at that time, but there was not really many statements in addition to this because of the secrecy of why Samawon was fired. Now, here's where things get really, really crazy. Most people don't know about superalignment because it's something that is in the future. So if you don't know what superalignment is, this is OpenAI's plan to solve Super Intelligence. And that is basically a system that is much better than AGI. So it says, our goal is to solve the core technical challenges, or super intelligence alignment in four years. And basically what they did was they decided to build a specific team to solve this specific problem, because they knew that in the future they're going to have AGI. And after AGI comes asi, which is artificial superintelligence. And super intelligence is quite hard to explain. But just think of it like this. If AGI can do a better task than any human at pretty much everything, and it's going to be everywhere, artificial superintelligence is going to be able to do things that you can't even fathom. It's going to be able to create new knowledge, do new research, discover cures for certain incurable diseases. At the moment, it's pretty much going to feel like a magical time if we manage to get super intelligence. Right now, essentially, with super Intelligence, you've got the problem, because you're building a system that is that smart, it could go rogue. And if they're super Intelligence goes rogue, we literally don't stand a chance. Because if a system is super intelligent, it's going to be able to outsmart us, and we're not going to be able to understand what its goals are or even what it's doing. And you can see here that they said that this might not even work. It says, whilst this is an incredibly ambitious goal, we're not guaranteed to succeed. We are optimistic that a focused, concentrated effort can help solve this problem. There are many ideas that have shown promise in preliminary experiments, and we have increasingly useful metrics for progress, and we can use today's models to study many of these problems in empirically. So here's where things start to fall apart for OpenAI. Okay, here's where things really start to, you know, like the alarm bells really start to go. So Ilya Satskava, okay, has made this core research his focus and will be co leading this team with Jan like, the head of Alignment, okay? And it says joining the team are researchers and engineers from previous alignment teams as well as other researchers across the company. Now the thing is, okay, this Super Alignment team that was meant to to figure out how to solve the alignment problem for artificial superintelligence, okay, Ilya Satskova is now gone and Jan like today actually quit. Okay? So two key members of the Super Alignment team are now gone. You can see that earlier today Jan like literally tweeted, I resigned. Okay? Now the thing that I think was the most interesting about this was the fact that Jan like didn't say anything other than I resigned. Remember when Elias resigned, he said this heartfelt message that, that shows that he kind of cares about OpenAI and where it goes. But Jan like stating that I resigned with just no further context. I mean, it leaves it open to complete speculation with as to why he did resign. Now like I said before, this is a problem because these were the people that were trying to solve Super Alignment. But you have to understand that this does actually get a lot worse because they're not the only people that resigned from Super Alignment in terms of the team. Now one of the things that you need to know about Super Alignment and a lot of people are starting to speculate is that because the head of Alignment at Super Alignment resigned today, maybe this means that they solved the alignment problem, okay, in terms of aligning a super intelligence. So if you don't believe this, let's take a look at what Jan like said in a recent interview. Now, I've listened to this, it's over two hours, but this is the main bit that you need to pay attention to. So he says, if you're thinking about how you align the superintelligence, how do you align a system that's vastly smarter than humans? I don't know. I don't have an answer. I don't think anyone really has an answer. But that's also not the problem that we fundamentally need to solve. Maybe this problem isn't even solvable by humans who live today. But there is this easier problem. How do you align the system that is in the next generation? How do you align GPT N +1? And that is a substantially easier problem. So it's basically saying, how do you align currently GPT5? Then when you have GPT5, how do you align GPT6. When you have GPT6, how do you align GPT7? So he's basically stating that that is a much easier problem. And he goes into more detail here, and he says, okay, and this is basically the highlighted part. And so if you get a virtual system to be aligned, it can then solve the alignment problem for GPT n + 1, and then you can iteratively bootstrap yourself until you're at superintelligence level and you figured out how to align that. So basically he's stating that even if humans can solve the problem of GPT N +1, basically humans shouldn't be doing that, but a virtual system as smart as humans should be doing that. And then if you get that system to be aligned, it can then solve the alignment problem for GPT N1. And then you can iterably bootstrap yourself until you actually at superintelligence.

If you're thinking about like, how do you actually align a super intelligence, how do you align the system that's vastly smarter than humans? I don't have an answer. I don't think anyone really has an answer. But it's also not the problem that we fundamentally need to solve, right? Because maybe this problem isn't even solvable by humans who live today. But there's this easier problem which is like, how do you align the system that is the next generation? How do you align GPT N +1? And that is a substantially easier problem. And then even more, if humans can solve that problem, then so should a virtual system that is as smart as the humans working on the problem. And so if you get that virtual system to be aligned, it can then solve the alignment problem for GPT n + 1, and then you can iteratively bootstrap yourself until actually you're at superintelligence level and you figured out how to align that. And of course, what's important when you're doing this is like at edge, each step you have to make enough progress on the problem that you're confident that GPT n +1 is aligned enough that you can use it for alignment research.

And he says, of course, what's important when you're doing this is that at each step you have to make enough progress on the problem that you're confident that GPT N+1, the next model, whatever it is, is aligned enough so that you can actually use it for alignment research. So basically what he's saying is that every time we go and increase from GPT4 to GPT5 or whatever, next frontier model is we have to make sure that that model is so aligned that we can then use that current model for alignment research. But this is why a lot of people now have thought, okay, that if two of the key members of the founding members of Super Alignment have now left, okay, remember these guys left. They didn't get fired. These guys left. That means. And remember he said, I resigned, okay, with nothing, no further context, that means that maybe they actually managed to solve this alignment problem, okay? And if you think that it's not that bad, take a look at this. This person, Leopold, who used to work at superalignment at OpenAI, he also no longer works at OpenAI. Now, he was actually fired, okay? It says OpenAI has fired two researchers for allegedly leaking information, according to a person with knowledge of the situation, okay? Leopold and someone else, okay, who was also an ally of Ilya Sutskova, who participated in a failed effort to force Sam Altman last fall. And you can also see here, it says OpenAI staffers had actually disagreed on whether the company was developing AI safely enough. Now, what's crazy about this, okay, is that the two people that.