The OpenAI debacle (a retrospective)

Welcome to Practical AI. If you work with artificial intelligence, aspire to, or are curious how AI related technologies are changing the world, this is the show for you. Thank you to our partners for helping us bring you practical AI each and every week. Fastly.com fly IO and typense.org.

What's up friends? AI continues to be integrated into every facet of our lives. And that remains true because you can now index your database with AI. You can write more code, become that 10x where you always wanted to be, and you can even draft a letter for a lease on an apartment or a new property. AI is everywhere and it might be time for us to start questioning. Is AI our friend or our worst enemy? And that's the focus of the three part season opener of the award winning podcast called Traceroute Podcast. You can listen and follow the new season of Traceroute starting November 2nd on Apple Spotify or wherever you get your podcasts. And this show is all about the humanity and the hardware that shapes our digital world. In every episode of Traceroute, a team of technologists seeks to untangle the complex question, who shapes the Internet? Seasons one and two gave us a crucial understanding of the inner workings of technology. Technology, while revealing the human element behind tech in season three tackles not just AI questions, but also how can we use technology to preserve the earth? Who influences the technology that gets made? And what happened to the flying cars we were promised? I think it's safe to say that the future of AI is both exciting and terrifying. So it's interesting to hear the perspectives of experts in the field. Listen and follow this new season of Traceroute starting November 2nd on Apple Spotify or wherever you get your podcasts.

Well, welcome to another fully connected episode of the Practical AI Podcast. My name is Daniel Whitenack. I am the founder and CEO at Prediction Guard and I'm joined as always by my co host Chris Benson, who is a tech strategist at Lockheed Martin. How you doing, Chris?

Doing very well today, Daniel. It has been quite a past week or so.

It has been quite a week. We've had a couple. Well, in the US we've had usually people take off a couple of holiday days for Thanksgiving, but even leading up to that, and during that there was, you know, all of the craziness of, I think, what will be remembered as a very unique Thanksgiving season in the AI world at least.

Yes, it's been a soap opera, to say the least.

Yeah, yeah, I was trying to think up a good pun from a soap opera title. Days of our lives or something, but I couldn't. I couldn't think up one for OpenAI. Days of our artificial lives, or. I don't know what it would be. I don't know.

It's just. But it's definitely. I mean, not even day by day, but like. Like at some points, you know, hours by hours. Radical changes along the way.

Yes.

So it's. And of course, we're talking about the. The saga of OpenAI and all that happened, which is what we're going to talk about today.

Yeah, yeah, I. I mean, I think it's what we have to talk about. And I think rather than just us giving a few hot takes, which I hope that we will have, I think it would be good to kind of step back, back and kind of look at the history of OpenAI, how it came about, and the progression of OpenAI as an. As an entity and their offerings, which kind of frames up some of, I think, the. The drama that we've seen over the past week. The week of Thanksgiving, November 2023. You know, it's interesting, Chris, I was looking back, we had Wojciech Zaremba from OpenAI, one of the founders, early on. Yeah, yeah, one of the founders. And that was episode 14 of this podcast. We're now on about 250, I think, somewhere in there. Yeah. It seems like from those early stages till now, we've been kind of going on our own journey in parallel with OpenAI, as they've had this amazing journey as a company or as an organization. And way back then, when we were talking to Wojciech, we were talking about, really, reinforcement learning and robots. Um, I don't know if you remember at that time, they were doing these, like, robotic arms, and they would have, like, stuffed giraffes, and they would hit the robotic arms with the stuffed giraffes, which is kind of comical, but it was like a perturbation. They were trying to create kind of robust reinforcement learning to control robotics. And that was kind of. I need to look back at the episode. I think that was basically what we had talked about back then. That's. That was kind of the focus.

I remember being very interested in that episode. And he's such a smart person. Holy cow. Because I had been leading up the first AI team at Honeywell at the time, and we were doing also robotic arm work within Honeywell's business using, you know, convolutional nets to see. And it was early days compared to what we're doing these days. But holy cow, those guys he was so smart. That was one of those episodes that's really hung with me over the years. Yeah.

And kind of stepping back and taking a wider view of OpenAI as a whole. I'm even looking at the transcript of that episode now and at this time would have been, I guess, four more years ago. Wojciech said the goal of OpenAI is quite ambitious. It's to figure out a way to build artificial general intelligence or artificial intelligence, or to be more exact, how to build it in a way that it's safe or that we can control it. And he says, let's say, figure out from a political perspective how to deploy it in a way that's beneficial to humanity as a whole. So that's kind of one little clip from that episode. And if you look at OpenAI's founding, if we just take a look at how it was founded and how it progressed to this point of the chaos of last week, it was really focused uniquely on this problem of creating an organization that would steward us towards artificial general intelligence in a way that was beneficial to humanity. And there were various people involved in that, various funding groups we mentioned. Wo check. But of course, Sam Altman, who has been in the news a lot, Elon Musk, Greg Brockman and others that were part of that original group when the organization was founded in December of 2015.

I want to explicitly point out it was set up as a nonprofit at that point in time.

That's correct.

Which somewhat changed as we'll talk about.

Yeah. Which maybe was part of the tension that led to last week.

Indeed.

Yeah. So it kind of had this initial board. Sam Altman was part of that. Of course, he was in the news a lot this last week. Prior to OpenAI. Sam was the president of Y Combinator from 2014 until 2019. And I know that there was some things in the news kind of trying to imply certain things about why he was let go or fired or left y Combinator in 2019 and trying to tie those forward. I don't know that that was totally coherent for me in terms of what it was. But anyway, that's kind of his past in this startup venture backed world. I think that would be the. The key thing to highlight. There is he's coming from this sort of venture backed startup world, ipo, raise a bunch of rounds of funding and kind of big tech mindset, I guess.

Yeah. I agree with you. I think that was the very beginning in my sense of it at least of kind of that tension is that you. It's a Very different culture from a nonprofit effort in terms of the kind of the way you run your business and such as that.

So, you know, one kind of key, other commercial player in this would be Microsoft, who has invested at this point over $10 billion in OpenAI Global LLC. So that will be an important maybe distinction here in a minute. But Microsoft is a big player in this, which is why you might have seen Microsoft's CEO making statements during the past week, etc.

Correct. For whatever reason, you know, kind of going to that point because that, that is a structural concern of OpenAI that is by almost any account a little bit bizarre. You know, and even this podcast is almost as old as OpenAI. We're not quite there, but we were, you know, when 2019, we were operating when all this stuff was happening. And I remember it and they've sort of created, they have the parent company which is nonprofit, and the short of it is they have this LLC which is a for profit entity, which is a, a subsidiary of the nonprofit. But all of the, because of the way they're operating now, all of the funding, the investment, everything has gone into the llc. And yet you have this group of disconnected investors from the daily operations operating at the nonprofit level above. So it's two entities that were never really intended to operate together in a direct legal manner, at least from an intent standpoint. And somehow the attorneys have made this all work so that it is legal.

Yeah. When I was looking at like key takeaways in terms of what we're doing here, which is sort of a retrospective on this crazy week of events.

Yeah.

One of the things which is not really related to open AI, but if you're in business was a key takeaway is like, don't create convoluted corporate structures. No, it's not, not gonna help anybody. So there you go. That's a non AI tip. If, if you're in the process of structuring some complicated corporate thing, try to simplify it. But yeah, you're, you're right, the start was nonprofit and NPR even quoted this as kind of like it's almost like an anti big tech company. That's how they quote, unquote referred to this non profit version of OpenAI when it started, that it would prioritize principles over profit. Again, the idea with the founding of this was it would be a way for the best AI researchers in the world to help steward this really disruptive and potentially harmful technology in some respects into the future in a way that it would benefit humanity. That was kind of the framing, I.

Think that really plays into what ended up happening, which developed over the years, is that they were doing two things. They were serving that mission as they founded from 2015 on. But as we have all learned and talked about quite a lot over the years, it's very, very, very expensive. Yes. To create these large models. And so you get the sense of they were constantly fundraising and they hit this point where they needed, they needed a serious infusion of cash to push forward where they were wanting to go. And I think Microsoft comes along and says, well, we'll give you an initial billion. But that also happened at the same point where this new corporate structure evolved. And I think that that was all tied together as well, as I can tell from reading many, many articles on the topic, to get that investment going. And so they did that. They got the new thing, they got the initial infusion of, and then the year after that they got 10 billion more from Microsoft. But by doing that, you had the driving forward on, on, you know, how fast can we get there and be the leader and do this? In that entire startup kind of culture, contending with the. Our mission says we're going to do this for humanity and we're going to do this safely. And you can see the. They're crashing together and have been the last week or so.

Yeah, yeah. So specifically what, what you're referring to, Chris, is this transition from a nonprofit organization to a quote unquote capped for profit, which I had no idea it even existed until the 100 time cap. Yes, until we started talking about this a couple years ago, but yes, a cap nonprofit where the profit would be capped at a hundred times any investment, which according to the numbers that you just told me, investment would be a significant profit regardless. But a capped nonprofit, and according to OpenAI at the time, and I think what they've said, this really had to do with attracting talent and attracting investment at the levels that they would need to achieve this progress towards artificial general intelligence that would benefit humanity. Now there's two kind of key pieces here. The OpenAI Inc. Which is the nonprofit. So it's very confusing and maybe slightly annoying to have to refer to these differently, but OpenAI Inc. The nonprofit, and we mentioned a second ago, Microsoft investing in OpenAI Global LLC, which is the capped for profit. And what's interesting is that essentially this created a scenario where the board which had full control of the capped for profit company as a nonprofit, couldn't have a board member that would have some sort of financial stake in the for profit company, which all of that seems kind of convoluted, but let me say it again. So like the board that's controlling the OpenAI entities could not have members on it that would have financial stakes in the capped for profit OpenAI Global LLC. Which means that Microsoft, for example, as a huge investor in OpenAI Global LLC, did not hold a board seat on OpenAI Inc. Which will play into kind of the timeline that we'll talk about here in a second of what's happened over the past couple weeks.

And one other thing to throw in on that is, though I am not an attorney, I'm fairly sure that the 100 time cap was one of the mechanisms by which they could make the for profit fit into the nonprofit. Because pure for profits in theory have essentially unlimited ability to generate profit. Nonprofits are not allowed to have profit. You know, you must use those expenses. And the 100 times caps, I think was something of a bridge. So I say that from a I did not go to law school to learn this, but I'm pretty sure it's tied in there somehow.

Well, Chris, in this saga of what's happened, we have this nonprofit, originally, OpenAI Inc. That has spun out this for profit OpenAI Global LLC, which has received a huge amount of funding from Microsoft, and as we all know, over the past couple years has really become the dominant fund force in the AI industry with releases of all sorts of amazing technology and tools and of course, most recently ChatGPT. So it might be worth just kind of giving people some context around this of like what happened over those years with OpenAI that made it such a driving force, which eventually led to, I mean, you could have a company that has a convoluted corporate structure and it blows up and the CEO gets fired and, you know, no one hears about it in the news. And our lives pretty much go on, although it's probably unfortunate for their lives. But here, this had an impact kind of on the whole AI industry and I think will have an impact on the AI market moving forward because OpenAI was such a dominant force in the industry. So maybe we could go back and visit some of those milestones and the history that came along from those early days when we were talking about robots and stuffed giraffes to now where we've got GPTs, I guess so back in 2016. So this would have been almost when we were starting the podcast, Nvidia gifted the first DGX1 supercomputer to OpenAI.

It's quite a gift of the day.

Yeah. So they were kind of early on into this wave of really powerful, cutting edge GPU powered supercomputers that could train larger and larger models, which is one of the things that's of course led to these very powerful foundation models that we've seen in recent years. I don't know if you've got. They haven't gifted you one and you have it in your garage or something. Chris.

No, my first DGX one was, which was when that was all there was on the DGX line, the original one I got at Honeywell and we had it under a desk for a while because we, we got it and then we had to figure out how to get in the data center and stuff. But yeah, that was. I remember thinking, wow, I gotta, I have an AI supercomputer under our desk here. This is amazing. Anyway, little side story and in those.

Kind of years after that you see what maybe I would consider and I know it's hard to make generalizations like this because there's a lot going on at OpenAI even now. But in those early years I think you really saw this kind of exploration phase of setting up the right tooling, setting up the right compute, letting researchers explore various things like the robotic stuff like RL computer vision things. And you saw things like the universe software platform, OpenAI Gem, which I know I've used in workshops for like reinforcement learning type of thing. So you really saw this kind of wide range of exploration in those early years leading up to February 2019 when GPT2 was announced. And this was the first kind of from OpenAI, at least the first major language model or foundation model, base model that gained a lot of attention for its ability to output really human like coherent text of course is the first in the line leading up to the latest GPT models that we see now like GPT4. But that was in February of 2019. Still something that I think was basically just being looked at by people like us.

Yeah, episode 32 of our own podcast was covering that.

Oh, there you go. Episode 32, GPT 2, episode 32. It's interesting now, Chris, when I'm helping people learn how to like fine tune a language model or something like that, I'll often use GPT2 and it's interesting to see because now this would be considered a very small model and not only that, but it's open, right? So OpenAI was by its very nature and stated aims going to be very open with its research and models and IP and all of that. So GPT2 is on hugging face. And it's a great model to use even now to kind of figure out how to fine tune language models. But it's just interesting to Compare that to, for example, GPT3 5 or GPT4. I'll never see those models in terms of downloading the weights and all of that.

It became a different org.

Yes. And with their own reasons for doing that, and that's their decision. But yeah, in 2020, then. So a year later, OpenAI announced GPT3, which was a language model that was more extensively trained on this sort of huge corpus of content from the public Internet. And, you know, so it was a lot of scraped data and all of that. And I think this is really where you started to see some pretty crazy outputs from these language models. What people might have thought not possible. They started to see this with GPT3. This is also where you kind of see this shift within OpenAI to from releasing GPT2 as a model, to releasing GPT3 as an API with a more gated release, a slower release. I was even reading in some of, kind of the lead up and debriefing from the chaos of last week that you could interpret some of this slower release of GPT3 as an API and a product to really this tension that you're seeing between a startup kind of mentality wanting to fail fast, release things, fast, learn from things in public, and this kind of more shielded, nonprofit, good of humanity side that is wanting to do things maybe in a more slow way that ensures safety and releases things not with harmful outputs, that sort of thing. So you see this kind of starting to really collide and come together. I think around GPT3, GPT2, GPT3 were language models, caused a big stir in the AI world. Again, still not something that public, you know, as far as ChatGPT wasn't something that a lot of people knew about in the general public. I think even when they released Dall? E in 2021, this was kind of text to image model where you could, you know, put in your prompt the astronaut riding the horse on the moon, and you could get that. And I think the public saw that as still kind of like a novelty and that sort of thing. And that led up all the way to December 2022, of course, when AI started, when ChatGPT was released, at least in free preview, which changed the world.

Yes, when we were talking, even going back to Dall? E, people were aware that there was this thing and they saw all these crazy AI pictures. But if you had asked Someone who wasn't following this industry the way we do. Most of them out there, they would have said, oh, I've seen some of those photos. But I couldn't tell you what the organization was at the time. They didn't know. Yes, that really changed with ChatGPT. The whole world woke up to this stuff.

Yeah. And I mean, we've been talking about OpenAI in this podcast pretty much nonstop since then, and everyone else has as well. Of course, ChatGPT isn't the only thing going on in the AI world, and hopefully we're representing that on this podcast. But it is certainly a driving force and we've mentioned it a lot, and that's why the events of last week caused so much stir. It's worth noting still, things happen after ChatGPT, right? We had GPT4. We had, I think, what you saw as a shift in public discourse from Sam Altman and Greg Brockman at OpenAI really related to, hey, we need to really provide recommendations for governance of superintelligence, governance of artificial intelligence, and also at the same time, rapidly releasing new products as well. So you see this again, this tension, right? Like, hey, we want to talk publicly about governance of superintelligence and regulations around this. And at the same time, we're going to have our OpenAI dev days and release four new offerings which are going to blow your mind and immediately permeate all industries, right? So you've got GPT vision and the GPTs plural, which is kind of easier ways to create customized models and systems and rag workflows along with other things like their assistance playground and API. So you have, again, this, like, you just see these two things kind of coexisting where I'll use The words of NPR, they, quote, say two competing tribes within OpenAI adherence to the serve humanity and not stakeholders credo, and those who subscribe to the more traditional Silicon Valley mo of using investor money to release consumer products into the world as rapidly as possible, end quote. So you see this even in this past year, I think, in public discourse and in the release of products. And that leads us all the way to November 16th. So, I don't know, where were you on November 16th, Chris?

You know, we're talking like this great historical moment as we're recording this. This is what, Sunday afternoon. This was a week and a half ago that we're talking on a Thursday. And so the whole thing happened in that week before Thanksgiving, and it was done in one week, from a Thursday basically, to a Thursday to a Thursday for all Practical purposes or Thursday through the Wednesday and it was working and happened to look at the news and the first thing I saw was OpenAI had fired Sam and was like, which.

Was crazy because it was like right after his keynote.

I know, a day, a day later. It was a day after his keynote.

Yeah, yeah, it was just mind boggling. Yeah. So apparently he got a text on Thursday night from one of the co founders asking him to join a Google Meet on Friday and they had already kind of tapped the cto, Mira Muradi as the next CEO. And on Friday, literally Microsoft learns of Altman's firing quote a minute before the world does again.

So it was on Friday that we heard it actually not Thursday, but yes, yeah, yeah, exactly.

So it happened while, got into motion on Thursday and then some of us heard about it on Friday and apparently also Microsoft, which was just, you know, so I knew about the kind of convoluted corporate structure and all of that, but it was just mind boggling to me that Microsoft was not informed about, about this given their investment in the for profit entity, which I think they.

Have 49% stake in, if I recall correctly.

Correct. Yeah, it's something like that. I don't remember the exact figure, but certainly they've invested over $10 billion with plans to invest 10 plus more billion dollars. And of course they've integrated OpenAI, ChatGPT, et cetera, into Azure, into Bing, into Microsoft Office 365. And so yeah, it just sort of boggles the mind that this happened in the way that it did. So then on the 17th, then OpenAI releases a statement that Sam Altman was ousted and later that evening, Greg Brockman announces he's quitting.

They got rid of him as the chair, so he was fired as chair. But then he turned around, he was still president. And he was, and he quit as president standing to show Sam Altman that he stood with him.

Okay, well that brings us to the point, Chris. Sam and Greg are out and Microsoft on that next Saturday, then kind of going day by day, Microsoft releases a statement saying that they, and I don't know if you saw the video, the Microsoft video, but essentially they immediately offered to hire Sam Altman into Microsoft and.

Greg and anybody that left OpenAI would enroll.

Yes. And I think I could tell in those videos just the sort of still shock and unbelief in a lot of people. So Microsoft releases these statements. People of course, start wondering why did this happen? This had to be something really bad that Sam did. Like why would this ever happen? And There was some reporting and some statements that basically were kind of confusing and murky, that they were saying, you know, no, it wasn't like any violation of security or privacy practices or kind of malfeasance on Sam's part. But you kind of got like these vague hints of, oh, he wasn't completely forthright with the board and his communication didn't allow them to properly make decisions. And so you get that kind of mix of stuff going on until November 19, when Altman announces that he has been hired into this new research unit of Microsoft and posts on Twitter X. The mission continues.

And in the meantime, Mira, you know, was the first designated CEO. They had another CEO for another day on Sunday and then a third one, you know, they. They went through CEOs, you know, one a day for a while there.

Yes, I was on my zoom calls when I was hopping on. I was asking people if they had been asked by OpenAI to be the next CEO yet, because it seemed like they were working their way down a list. I don't know how far down the list. I was kind of sad I wasn't in that top 10. But they were definitely working their way down some type of list.

And I forget the name of the one that came after Mira, just. It's escaping me right now while we're talking, but the OpenAI employees were reported to on their internal slack, were using, I'll gently say fu and showing the middle finger on their slack. Apparently, the employees had had enough by the time we got to midweek. And going from Saturday into Sunday, the employees started finding their voice, as we'll hear about next.

And there were reports basically that up to 95% of the employees within OpenAI were going to depart OpenAI if some deal wasn't struck to have Sam Altman return as CEO, which obviously would be the end of OpenAI, at least as we know it. So I don't know. I could definitely tell you that. And this is one thing I'll highlight later on is all of these people who have relied on OpenAI as the sort of bulwark of, of the industry and integrated this across their products were really in a state of panic, right? Because it's like, hey, you know, the OpenAI is still saying they're going to provide great support for all this stuff, but also you're saying, like, potentially 95% of your employees are leaving. So where does that leave all of these? So it was really kind of a time of reckoning where it's like, hey, you know, we've built a whole strategy around OpenAI's products and models. So now what? And you know, the resilience of relying on this kind of single family of models I think really, really was showing in that moment.

If only there were services that could help people find a variety of different models and not be entirely dependent on a single family prediction card. I didn't say that.

Yeah, yeah, sorry. This is a point we'll make later, but I think it does. We even a few weeks ago had had some comments about with the executive order is their firming up of the market around these kind of foundation models because of the regulatory burdens that would start starting to be put on them. Right. And I think that this kind of opens up the field a little bit more. Regardless of what has played out with OpenAI, I think people are really wrestling with the fact of, hey, what else is out there? And of course you've got amazing players in that space, from mistral to mosaic, ML to meta and what they're doing with llama2 and people really finding, you know, of course we're helping at Prediction Guard, helping people build with these models, but a lot of people are finding a lot of success with these models. And I got a number of messages during this chaos about, hey, you know, we weren't thinking about trying open models or models outside of the GPT family prior to all of this craziness going on, but now we're wrestling with that. Not necessarily over the fence yet in terms of a strategy around that, but it's definitely caused people to think a little bit more about this kind of market.

Yeah, having backup through diversity, if you will, in terms of model selection is now going to be in the, you know, corporate consideration for any significant organization going forward. We've seen the chaos and that will change the marketplace in general, so.

Correct, correct. That brings us all the way to November 21st of 2023. So this would be Tuesday, I believe, when OpenAI releases a statement that they've come to a quote, deal in principle with Sam Altman to return as CEO with a completely new board which is chaired by former Salesforce Co CEO Brett Taylor. And so one way you could take this is the sort of Silicon Valley Venture backed world 1 like the board is now chaired by a leader in that space. And so a big question mark kind of hangs over this. What about that original vision mission of the OpenAI nonprofit? Is that completely dead or does it still exist? I think that's a real question to ask.

Yeah. If I was channeling the OpenAI marketing team, I would expect that they would say, absolutely, that still exists. That's a. That's an overriding mission. But I would also suggest that the marketplace is probably not convinced of that at this point in time.

Yeah, for sure.

Before we go on, I just want to point out one thing. Another big, big retro consideration that will not go quickly is the ability for the voice of the employees in a unified stand in such a corporate. You know, this was the biggest AI company in the world in the sense of mindshare and what they're doing models. And the employees made this happen when they said, you're not going to have an organization if you continue down this path. That made a big difference. And I think that's another thing that we will see play out in organizations going forward.

Well, there is one more piece of the mystery puzzle here, Chris, which is now a meme in and of itself. I would say it is. So they struck the deal with Sam Altman, and then Wednesday, November 22, if I'm getting the date right there, was reporting that ahead of Sam Altman's departure, some researchers wrote a letter to the board of directors of OpenAI telling them about this discovery or new model that was being worked on called Q, Q asterisk that they basically said was a threat to humanity. So this brought up new kind of questions around was Sam Altman not taking this seriously and that's why he was fired, or did it play in at all to this? And then, of course, immediately, in addition to all of those questions, people started speculating, well, what is Q Star and is it a threat to humanity? And there the memes started across the Internet.

Our extended family got together for Thanksgiving. And I make a point of not bringing up AI. I mean, this is like, you know, we have broad family, lots of interest, not in AI in general, you know, or even technology in general. And this immediately came up as the first big topic. Everyone is scared about whether Q Star is this threat to humanity. And it is not you and I and the rest of us AI folk talking about this. This is the general population. I was really quite startled to sit into the family gathering and have that become the primary conversation. I was not expecting it.

Of course, everybody's going wild about this. Just like when they were going wild about, you know, anticipating what is GPT5 or GPT 4.5 or whatever. The next thing from OpenAI is. There's always going to be this level hype around it. I think what we can kind of practically know is maybe based on what they said, which is that the report basically said that this was a model that could maybe solve math problems better than previous models, which has always been a sticking point for these generative models. And the Q in the name kind of hints at this having some sort of reinforcement learning aspect to it, because one of the main kind of mechanisms within deep reinforcement learning is called Q learning, which is kind of a mechanism by which an AI model or a policy model tries to predict the long term return of making an action. So essentially planning, which I think you also forwarded me along LinkedIn post.

Yeah. Jan LeCun. Yeah, I'll read it. He weighed in because keeping in mind prior to him, this came out a couple of days ago, he put it out, at least on LinkedIn. He probably put out on Twitter too. But it was exactly to your point right there. He had been watching several days of this kind of hysteria about Q Star and people panicking. And I will note that there were some pretty crazy news articles about it along the way. What Dr. LeCun said was, Please ignore the deluge of complete nonsense about Q Star. One of the main challenges to improve LLM reliability is to replace autoregressive token prediction with planning. To your point, Daniel, pretty much every top lab, and he names a few, is working on that and some have already published ideas and results. It's likely that Q star is OpenAI's attempt at planning. They pretty much hired Noam Brown to work on this and I think he was trying to get back to practical AI from his perspective.

Yeah, and I think this just represents a sort of wider rift in the AI research community as well, where you kind of have a race to dominate the market with new models, kind of at odds with this really zealous promotion of like trying to prevent AI from advancing beyond our control. And so you, you see this playing out not just at OpenAI but elsewhere, and I think that led into some of the Q craziness. Well, in terms of retrospective, as we kind of, you know, we've told the whole story, we've stepped back and looked at OpenAI. There's definitely, from my perspective, some takeaways. Of course, I'm actively leading a company that is providing hopefully trustworthy LLM APIs in enterprise environments that, you know, can be self hosted. So my big takeaway, and I think what I was busy doing all week was answering people's questions about, hey, if I don't have OpenAI, what is there? And it turns out that there's a lot. So, you know, it doesn't necessarily have to be our APIs. But there's a lot of options around using enterprise models in a safe secure environment that can be deployed under your control. And yes, there's kind of this balance to take around. Like hey, OpenAI's APIs are really good because they're a managed service, but they also have downsides and I think you've seen this over time with other managed services. Right. Like with running your own database, there is a trade off right between relying on a, especially if it's a one off unique hosted service that is a single point of failure versus kind of hosting your own or maybe having your data spread out with different databases across your infrastructure. Like you see some of that kind of infrastructure concern and you know, the concern around the resiliencies of these systems really playing out and I think that we'll see other companies rise to that as well.

Right.

There's going to be new kind of wave of these companies that play off of what has happened over the past week to provide enterprise solutions.

Yeah, AI risk management as an industry field has been born. That's what's happened here.

Yeah.

AI isn't just the data science team that is going and either using APIs or in some cases using creating their own models. You now have risk management as a formal corporate concept that everyone will be adopting and will go through all the ranks of every organization. So an entire new industry has been born out of this.

Yes. Another point that I saw being made is this is kind of a wake up call to regulators as well. You have companies testifying before Congress to tell them how maybe they should be regulated. But this is kind of a wake up call that hey, you know, maybe these companies aren't so good at regulating themselves that often. So maybe there needs to be a different way that we approach regulation of this technology. And I think you see other evidences of that. Coincidentally around the same time it seems that Meta has disbanded their responsible AI team. Now I'm not making a comment on. I'm sure that they have other thought processes going around that but it is an indication of maybe some of what was good faith efforts at this but in practicality at odds with commercial pressures. So yeah, it'll be interesting to see how that plays out on the regulatory side as well.

I agree with there's another cultural kind of in the large cultural issue regarding when is we're doing retrospective. If we go back just a few years on this podcast and not very far if you really think about it, when the subject of artificial general intelligence AGI would come up. We didn't take it too seriously. You know, it was one of those things that wasn't, wasn't really practical AI for us at the time. It was one of those someday maybe you know, kind of get their things. And I think that what we've seen in a couple of different waves, we saw it with chat GPT coming into being and the capabilities and the fact that it hit the public's consciousness so intensely. And then, you know, the concern, no matter what Q ends up being, regardless of what the outcome is. Thanksgiving dinners were actually with people with.

Genuine concern, whether it's general or not, it's general in a certain way.

There you go. And the power of it and what that would mean for their own lives, even if they had nothing to do with the AI industry. And so what we've seen change in the large is that the notion of artificial general intelligence is entirely legitimate to ponder, to be concerned about, to either fear or be excited about, or maybe a bit of all of the above. But that's a very different thing. If we were to go back a couple of years, we had a very, very different perspective.

Well, with that, Chris, I think that's a good perspective to kind of bring us to a close here. It's been an interesting Thanksgiving week, and on these episodes we normally also try to provide some learning opportunities for people. There's one that I would like to highlight quickly, which I think will be a lot of fun. Some of you might have heard of Advent of Code, which is something that a lot of people do, to learn new coding skills and try new things each holiday season. And I'm helping run an advent of generative AI hackathon with Intel. So that's happening December 5th through the 11th. So I would encourage you, if you haven't been hands on with these technologies and with these models. This is a great way to kind of get into that without spending a bunch of money and learn from a lot of experts in the field with access to really people that are working in this day to day. So check that out at Advent of Gen AI and we'll link that in the show notes along with all of the many, many articles that have been written about OpenAI over the past week. So. Well, interesting week, Chris. Who knows what we'll be talking about next week, but I'm excited to do it.

You never know these days. I'll tell you what. Yeah, we'll find out. Talk to you then. Man.

Foreign.

Thank you for listening to Practical AI. Your next step is to subscribe now if you haven't already. And if you're a longtime listener of the show, help us reach more people by sharing practical AI with your friends and colleagues. Thanks once again to Fastly and Fly for partnering with us to bring you all Changelog podcasts. Check out what they're up to@fastly.com and fly. And to our Beat Freaking residents, Breakmaster Cylinder, for continuously cranking out the best beats in the biz. That's all for now. We'll talk to you again next time.