A Report from the AI Frontlines with The Neuron's Pete Huang
27 Mar 2024 · 39 min
Pete Huang, founder of the Neuron, discusses applied AI for business and what he saw at Nvidia GTC. He covers Jensen Huang's vision for AI agents, the implications for India and emerging markets, and why consolidation among AI startups is coming.
Chapters
Today on the AI Breakdown, we are talking to Pete Huang, the founder of the Neuron. The AI Breakdown is a daily podcast and video about the most important news and discussions in AI. Go to breakdown.network for more information about our YouTube, our newsletter and our discord. Hello friends, back with another travel era interview. And today I'm really excited to have on the show Nick non Mayor Pete, as he goes by on Twitter, who is of course one of the creators of the Neuron, an extremely popular AI newsletter. Hello friends, quick note before we get to the rest of the episode. You have probably heard me talk about the AI Education beta over the past few months. We've had a ton of you participate, which has been amazing. And now we're almost ready to announce something big and something new. If you want to be one of the first to hear about our new approach to learning AI that is hyper practical, hands on, immediately relevant, continuously upgrading and anchored by community. Go to BeSuper AI and sign up to be notified when the project goes live. We're getting there in just a few weeks and I want all of you along for the journey. Once Again, that's BeSuper AI. In this conversation we talk about the rapid pace of development in AI, some of Pete's impressions from the recent Nvidia conference, and of course the way that an entire new media establishment is being built up around AI, which as you know, is very interesting to me. It is a really fun conversation. So let's dive right in. All right, Pete, welcome to the AI Breakdown. How are you doing, sir?
I'm good, how are you? Thanks for having me on.
Yeah, super excited. You know, having been through a couple different sets of call that emergent content creators in emerging tech fields, I can very confidently say that I think that the people who are doing AI content right now are way nicer and more sincere and more sort of like driven by the right things than as a, for example, the folks who might have been creating content in crypto a couple years ago. And so it's great to have you on. For those who don't know you are the Neuron, let's just start with a little bit of a background about what you're building and the context, I guess, that you have to sort of be paying as much attention to AI as you do.
Totally. So I wrote a newsletter called the Neuron. We have about 400,000 readers. The whole angle is to teach business leaders and knowledge workers how to use and leverage AI in their work and transform their business. Right. It is very much about Applied AI is not just, oh, all this like drama that's going on and everything. It's like, okay, like how do we actually make use of this kind of stuff, right? So we ship a newsletter every Monday through Friday. We've been at this since January of last year. I think kind of going back to your earlier point there in the introduction, I think the motivations here of the people creating content have been very different than the people who again are doing crypto stuff, right? Like crypto was all about financial gain and financial incentives, like things like that. And then here I think, you know, at least my motivation for doing this is very much look like this wave is coming and there's gonna be this very, very fast acceleration and the more that we can bring people along and sort of share what's going on and sort of drip feed the information of, you know, again, how this is gonna impact their work, the better.
Right.
And so we saw this as an, as an opportunity to get to do that. And of course it's been super fun to be in people's inboxes every day and share of course the news and contextualize it, but then also the tips and tricks along the way as well.
Yeah, it's super interesting. So first of all, I think huge congratulations are in order. There's been a million newsletters and this a little bit before the show, but you guys are in the sort of the very small number that have sort of risen to the top of the heap, which means you're definitely doing something right, I guess. What have you learned is that anything unexpected about the audience that's come here or the types of things that they're looking for that you wouldn't have imagined when you started.
Oh, such a good question. I think my biggest surprise is just how much interest there is in, in AI today. Of course, like I, I think that sounds pretty obvious when, when I say it out loud, but you know, I spent the last five or six years of my career in tech startups, right? And so scaling a lot of these software products and we oftentimes encounter these quote unquote, early adopter types. And in our minds that's a very specific Persona, right? These are the folks who are gadget geeks. These people are always doing research online. They sort of are very self sufficient on the Internet. They just somehow know how to use things on the Internet and find a way to certain resources. And when I started I was imagining, okay, there's going to be a wave of people interested in AI who definitely fit this profile. Certainly you know, I'm based in San Francisco. A lot of those folks are here, a lot of them are located in big cities, sort of, again, very self sufficient. What I've noticed is with AI, it is truly everyone, it is truly, truly everyone that is interested and that can benefit from the kind of resources that we're able to share and context that we're able to provide. The same folks who would not be trying sort of the next startup or the next fancy product that tech Twitter loves, they are going into ChatGPT or Claude or trying new prompt frameworks or trying new recipes that affect their work. Right. So I've been very pleasantly surprised by just how much interest there is around AI, the amount of attention that people give. And I think it's appropriate because I think you and I both know this, right, like this is having dramatic impact on businesses today. It's going to continue to be that way and ramp in the future. And so I love that people are spending the time and energy to pay attention to this because that's going to pay off for them. It's going to pay off in time savings every day. It's going to impact their P and L if they are business owners. And I'm really excited to see just how the future of business and work changes because of this.
Yeah, couldn't agree more. And I think that it's a very, there's a real mental reorientation that's required when you're sort of digging into this space to understand that on the one hand there are similar sort of early adopter dynamics, but that the profile of who's early adopting is so much more diverse and just larger than things we've seen in the past. Right. So it feels weird to say like ChatGPT has 100 million weekly users or you know, probably more at this point, but it's weird to call 100 million weekly users and the fastest growing product of all time early adopters. But if you kind of understand that the total addressable market of people using this is probably more like 4 billion, then it feels less like crazy to call it early adopters. And I've certainly found that the people who are paying attention to this stuff now kind of get that there's this interesting combination of urgency from the standpoint of not wanting to be left behind and sort of fear of missing out of opportunities, but also an excitement that, hey, I am seeing the future a little bit before the guy in the cubicle next to me to be a little bit reductive. And that's an Opportunity for me to jump some rungs on the corporate ladder or maybe finally break out of the corporate ladder and do that thing that I've wanted to do. And that's a very exciting, exciting energy, I think, to be around.
Totally, totally. I completely agree. And, and I don't know if you've seen these stats, but it's something like, you know, the people using ChatGPT or AI at work oftentimes don't tell their bosses. I mean, it's sort of this, sort of, oh, I have this secret with me that I know how to do this thing and it's giving me massive leverage in my day job. It's allowing me to go save an hour or two and go pick my kids, like go run errands during the day or whatever it might be. If you're working a remote job, um, or otherwise just do the things that I kind of want to be doing instead of the menial tasks every day or the boring work. Right, so I agree with you. The impact here is huge. It is definitely billions of people. There's also a geographic element, right? So, so I've taught some courses where the audience was primarily located in Southeast Asia and the Middle East. The awareness of the products, how many people have actually gotten hands on with those products? Way less than I would say in the US, in English speaking countries, in Western Europe, etc. So I think it's just with how fast this is moving, it's creating some disparity a little bit both within mature markets, but then also across geographies as to who is actually getting their hands on this thing and spending the time to be able to test and experiment and figure out recipes that work for them.
Yeah, well, you know what's interesting about that too. Contrast that a little bit with the fact that almost every survey that I see now shows that attitudes towards AI in, for example, the developing world relative to the west, it's way more positive in like the attitudes towards AI in India are massively more positive than in the us And I've spent a lot of time thinking about to what extent that reflects a natural sort of property that we're starting to see of generative AI to equalize opportunity from the bottom up, you know, where it sort of like levels the playing field in a way. And that being a better thing sort of for emerging economies or if it's just a matter of how sort of viciously negative the media cycle around it, you know, has been for the last year based on, you know, real concerns that people could have. But it's just like, you know, a real concern about, you know, X Risk turns into just like the favorite story that you could ever have from a clickbait perspective for media. And that's all Americans hear at this point, I think about it.
Yeah, yeah, I think, I agree with that. I think the X Risk stuff is. Look, that's a big issue, right? Like I don't have the answer. I certainly can't predict the future. But it is such a lopsided thing where like, yeah, theoretically the thing could be so bad in the end state or have some like devastating consequence that even caring 1% about it is probably the right amount. Right? And once you average it all out, it's all the stuff around. You know, I know the artist communities, the gaming communities are massively anti AI. There's this huge question around copyright and who deserves what compensation. And I generally think our current law and economic structure isn't set up, up properly to kind of serve those communities. And so I understand where they're coming from. I do think that a lot of it is the equalizer, right? Both on the micro level at the individual level and then also at the state sort of nation economic level. Right. On the first side, plenty of research that shows that the lowest performers without AI magically start to get to 80th percentile with AI usage, right? And that is powerful. That is very, very powerful. If you didn't have certain training, if you didn't have a certain context, if you didn't work a certain job before, you can ramp up in a matter of hours, days, weeks, right? And get to a pretty dangerous level of knowledge very, very quickly with the help of AI. Right? So on the micro level, at the individual level, that is, that can, that is game changing for, for an individual at work, right? And on the economic level for an entire country, I mean, these waves are massive and certainly a lot of it has to do with resourcing as to, in this case, you know, who has the sort of R and D talent, who has the computing resources, all this kind of stuff. But all these opportunities create room for certain countries to reorient their entire economies, right? So in this case I'm thinking of India and the Philippines where those particular countries are huge in bpo, outsourcing sort of offshoring services like these sorts of things, right? The US benefits tremendously from, from working with those countries. A lot of that work is getting replaced by AI or theoretically could be done by AI very soon. And so for those countries, it is a huge opportunity for them to Shift their focus and reconstruct a big portion of their economy to upskill their workers, to focus on higher value add services. And that fundamentally changes kind of, for example, India's position in the world. Right. And Jensen Huang spoke at this, I was at the Nvidia GTC conference. There's a very targeted question around certain countries that, that, that will benefit. And he called that India.
Right.
He said, like, this is a big moment for the Indian economy to look a lot more like the US than it currently does today and again, like change its position in the world, in the global setting. So all that put together, look, all this is going to play out in like many, many years, decades maybe. But it is something that's very interesting for us to think about on a longer time horizon.
Yeah, absolutely. Let's actually talk about the Nvidia event because. Because you were there. So we're recording this on Friday, March 22nd. It'll be out sometime, sometime this week while I'm traveling. But I'd love to hear, you know, what the event was like from, from the inside in. You know, it seemed like this sort of crazy step change in, in just the energy of this community. But, you know, what was it like to be there?
Oh, I'm exhausted. I will, I will say, like, I woke up this morning, I was like, I am just beat. So it was in San Jose, California. Nvidia normally is a developer conference.
So.
So this is just some of the context I picked up while I was there. It's normally a developer conference. They have not had this in person in the last few years. So the first time kind of getting back together there and look, it was wild. It was absolutely wild because it normally is like this, IT data center engineer sort of Persona that goes there. And this time it kind of just felt like everyone just wanted to be there to go meet the CEO, right? And Jensen Huang, every time, he was so good about it, right. He would just show up at the expo floor. He would just be walking around casually every time. Absolutely mobbed, mobbed for selfies and autographs and all these different things. And he was very kind enough to sort of stop and do that. You felt the hype for sure. And a lot of people wanted to have Nvidia's point of view of where AI is going. They're obviously such a critical player. Their stock has been going crazy. They're now, I think, the third largest company in the world, something like that. And all the energy, I think, was just trying to figure out where all this is going. And look like Nvidia talked mostly about their chips, right? Like that is the majority of their revenue. And I would bet that most of the people in that room did not know actually what goes into GPUs. They probably were thinking, like me, it's like, oh, bigger number is better. Like that's pretty crazy cool. And like more power equals, I guess, like more powerful AI at some point. But it's not like you really knew the engineering behind it and how big of a deal it was, right? So I think people are just excited to be there and they just love anything AI related. I remember last year, the first conference that had the generative AI name on it, even though it was run by a particular AI startup. Again people just mobbed it because they were just like, look, anything related to AI, I want to be there. And this was just, it felt very peak. And I imagine a lot of this was, you know, pretty different than the last time that they ran Nvidia GTC in person, but certainly a lot of like really, really cool discussion around all the opportunities in enterprise, in, in creative work in medicine, in protein and drug discovery, all these sorts of things. Right. And so it was a very, very wide sort of agenda on, on all the different ways that AI can be and really, really exciting to be there for sure.
In terms of like the, the trend lines of things going on in AI, particularly in the context of what people seem to be interested in or talking about, was there anything that was common point of discussion at the event that was surprising to you versus like, you know, there's certain things that we've seen over and over and over again are interesting to people. But you know, anything that was maybe outside of what you would have expected.
I would say the most surprising stuff was actually hearing Jensen talk about what the future, future looks like. So when we talk about the short and medium term, I imagine the stuff that you're referring to is, look, AI agents, like, you know, video is going to get even more insane. Like the images are going to get more insane and like, you know, all of a sudden TikTok is going to get flooded with like all this AI generated content. Like, yes, like a lot of that was there and you know, that I think was to be expected. Another expected thing is all these enterprise leaders trying to figure out what generative AI means for them, what are the resources I need, what are the technologies I should be looking at, what are the use cases I should be looking at. All that I think was also expected just because I think the current state of AI in the enterprise is everyone knows they need to paying attention, but they actually, they don't actually know what the use cases are yet. But the surprising thing was to hear Jensen say things like completely generated games will appear in the market in five to 10 years. And more broadly, his, his opinion that right now the state of computers is that when you use a browser, for example, and you're, you know, getting listening to this podcast, what happens is like your computer goes and navigates the Internet, sends a request and then goes to chase down that podcast content from a server somewhere and then brings it back. It's sort of retrieving all this information from a data server somewhere in the world that is hosting this podcast's content. Right. And what he was saying is in the future everything will just be generated on the fly. There's no more of this computer goes, talks to a server server, fetches the content and kind of brings it back. Everything will be generated, everything will be as if you had chatgpt on your computer all the time. And it was generating all this sort of stuff, everything that you see. And so the tail effects I think we didn't really get into, but just to paint that very clearly for a vision of the future of what computing actually looks like was pretty wild. And there were some of these sessions too that talked about agents in particular. And the impact of that that I think was again very forward looking. I'd say again, five to ten years from now, maybe even more, but just to get a little bit crisper, a more concrete image of what that all feels like was pretty crazy.
Crazy, yeah, it's. This is a particularly interesting line of, of conversation and maybe to intersect it with some of what we were just talking about with the society level issues. So I find that the folks who are enthusiastic in the long run about AI's impact on the world and the economy and stuff tend to have a sense that 100x the capacity doesn't mean that we need 1/100 of the people. 100x the capacity means we'll produce 100 times as much stuff and 100 times as much content and 100 times as much entertainment. And that's certainly my sort of belief. I think that if you just look at the pattern of human history, we have a basically never ending appetite for more variety, more options, more whatever. Right now I think a totally separate question. I think that the transition to that could be enormously painful, have incredibly problematic consequences, like things that we really need to address. Even though I'm long term optimistic and I don't think those things are mutually exclusive, but if you kind of zoom out to that future when you start to think about like just 100x entertainment, for example, 100 times more entertainment, you really do start to get into a world where the thing that makes sense is this sort of hyper personalization of content and games. And, you know, and I think that the way that that plays out and how much sort of value that that places on things that can actually bubble up to the top and create, you know, shared experiences across people, like all of them are really interesting questions. But it does feel like even if you just look at the difference between, like, what, what, you know, our parents had options to watch on TV in the 80s versus the entertainment options that we have from a consumption standpoint now, it does feel like you're sort of on this inevitable track towards mass personalization. So interesting that that was sort of a. The type of. Of topic that was at the event.
That's exactly right. And just to give you a little bit more color on what those conversations look like, Right. Certainly. Well, I was there with a group of content creators. Everyone was sort of talking about this question which, you know, most immediately affects a lot of YouTubers, for example, right. They're all sort of like, all right, are we all about to just, you know, do we have a limited lifespan on this thing? Like, are we. Do we actually feel optimistic? So, I mean, the hyper personalization thing, I think is very real. Right. We already saw early versions of this. I believe it was like Carvana that did a campaign where they took 2 or 3 million customers. Each one had a data point, right, which is this person bought this specific car. It was this model in this location at this time. And so they translated all that into, okay, we're going to make a video of like this particular car model driving through a scene that, with images that were reminiscent of the location that they were in at the time, they took what was going on in the world at the time, like certain holidays on that particular day or trends that were going on in social media, work that into the script. And they generated 2 million unique videos in a matter of three weeks. Now, the videos themselves were low quality. You can clearly tell that it was like an early version of this AI thing. But they could just repeat that same exercise two, three years from now, and it's going to look completely different, Right. It's going to start to look pretty high quality. I think the broader question is, you know, as human consumers, we are going to be limited by just how much bandwidth we have in our brain to consume all this content. Right. To give an example, on the B2B side, there was a stat where it was, you know, x many years ago, maybe 10 years ago, it would only take one, two, three phone calls or emails in order for a seller of a product to get in touch with a buyer to have some level of engagement. That Number is now 10, 15, 20 touches across social media, across email, across phone calls, whatever it is, in order for you to get some response. Right. Now let's play out the scenario that you're talking about where there's infinite supply, a thousand x supply, right? And today again, to paint out the impact of this. If you are a company that is selling, let's call it B2B software and you decide to change your positioning, how you talk about your product. Because it takes 10 to 15, 20 touches for someone to engage with you. On average, it takes six months from the day you start to change your positioning in order for the market to hear your message and start to resonate with it in that time period, in over the six months, you have to just keep on hammering the market with the same content over and over again. The question in my mind is if, again, if you,000X the content, how long will it take for you to make a change to the actual positioning of your product? Right. Does that go to two years, three years, or somehow with hyper personalization? And hyper personalization also implies, by the way, new ways of consuming content. We are no longer probably going to be viewing YouTube, the same YouTube. Right. Like our YouTube experiences are going to be like Pete's YouTube versus, you know, Nathaniel's YouTube. All these are going to be different things. Right. And so the delivery mechanism is also going to change. But how does that, what do we do with the content? Right. Does that mean that every piece of content only gets one view, which is the person that it was designed for? Right. That's a little bit different than the million sort of YouTube views that you get on a video every time the many thousands of podcast listens that you get. Right? So all these things change the structure of again, when you run the supply to a thousand x, a million x of, of what it is today, it's really, really hard to predict what happens. Things get kind of crazy.
Absolutely. We also have no idea what sort of counter reaction it provokes in people where some meaningful number of people, like go the opposite direction. And it's just there's so much personalization that even if I engage with that personalization in one specific area, like I Don't know. I person X like really likes some fantasy series and so they just like endlessly consume fanfic for that fantasy series. But otherwise they don't want hyper personalization. They just want the one cultural touchstone that, you know, stands out above the rest. Right. You know, whatever that might be at any given time. I think it's gonna be really interesting to see because, you know, things never happen all in one direction, they happen in the direction and then the counter reaction all at once.
Totally. I'm so glad you said that. I feel like that is. That actually surprisingly rarely comes up in my conversations and I always wonder why that is that people somehow tend to be over they. Sorry. They underestimate society's resilience. Right. Like people will react to things and they will develop a counter trend to all this. It reminds me of Alexis Ohanian, the co founder of Reddit. His bet on AI is sports because of this exact argument, which is there's a possibility that people's reaction to an excess of AI generated content is to disengage from technology completely. And instead what they're going to search for is in person, non tech, non AI related stuff. And sports, in his mind is the biggest bet on that. Sports as the biggest unifier, the biggest cultural touchstone of all. That sort of brings people together. That's his play. Right. Which is, it's just an interesting to think about all the different ways that society could react to with this.
Yeah, it's. I mean, listen, it is a super interesting thesis. I think that it's, it's very credible. And you know, the thing that's fascinating too is that it's not at all mutually exclusive from like these things. Both could happen at the same time. You know, the, I mean we're also living in a world where Taylor Swift has just completely destroyed all, all records for what a tour can be. And again, it shows that like the value that people place on these sort of unique in person, you know, group experiences where you're, you feel a part of something and it does feel that those things, you know what, what loses out is the stuff in the middle that are sort of sad approximations of those really great experiences. Right. Again, it's just sort of power, law, distribution. But the stuff that really delivers against those goals can get even more valuable to people.
Yeah, absolutely, absolutely. Yeah. I'll be so curious when we have the same conversation three years from now what the world is going to look like. I'm going to be very curious what our reaction is going to Be then.
Yeah. So, okay, so I have a specific question about a thing that happened while you were there that was disconnected from Nvidia. So I think it might have been the first day, it might have been Monday, or it might have been Tuesday. But the news that inflection was basically all heading on over to Microsoft Hit, which I think, you know, has a bunch of dramatic impacts or ramifications that we could talk about. But, you know, what was the. What was the response, you know, among the folks that you were hanging out with at the time?
The general take is one, whoa, that something like that happened. And then two, kind of expected. Kind of expected. I think the general take on inflection is, of course, like, huge story, like the CEO, and it's like Reid Hoffman's involved, like all these, like, great backgrounds of people starting the thing. They raised such a massive amount of money. They bought all these GPUs to. To build these models, and they built a pretty good model, like a pretty good product. But at some point in the last few months, the narrative really has turned against them and was sort of like a, what are they even doing? Like, even the product that they released, they weren't charging money for. It wasn't very clear, like, business use case. It was very personal and sort of meant for consumers. And so it was kind of like this thing of just like, what is this? Right? Is this just a front somehow to kind of give the CEO and to give Reid Hoffman something to talk about and kind of put on the resume? I. So I think it came down to that. I think when I think it was on Wednesday, probably a day after it happened, I was talking to people about this and I'm like, yeah, I mean, it's like, it's not like we lost anything. It's not like ChatGPT went away. No. You know, I mean, like, their product pie was good, but it wasn't like, like dramatically better or significantly different or anything like that. So I. I think it was just a more of. Okay, well, it's very clear now that just because you had a good background and raised a ton of money, it doesn't necessarily mean you're going to survive. Right. And I think inflection is maybe the worst offender of that. Perhaps just given how much they raised. It was something like $1.5 billion or something like that. Right. And no real product. Nothing. Nothing they were charging significant money for. The only question that people had was, okay, who's next? This AI hype is so real. Are there other companies that are sort of heading down that path that we aren't talking about. And it sort of hints at this sort of washing away thing that's going to, that might happen. Maybe it is overhyped and there's a little bit of froth in the market today.
Yeah, well, so you know, this is, so I've actually had this, some version of this conversation with almost everyone this week that I've been doing these, these interviews with. And you know the, there's certainly, it's very clear that the scale of resources it takes to compete to be an actual sort of frontier model, you know, creator is enormous and even more than people anticipated. Right. And so inflection in some ways I think to some folks feels like just right where that line is of competition, like even that 1.3 billion really wasn't enough to compete relative to everything else. Now a million other decisions that they made, you know, like they were attempting something new that, that didn't necessarily lend itself as well to you know, the sort of like instant turn on business model that, that you know, ChatGPT had or something like that. On the flip side, you have all of these companies that like just, there's no chance that they were going to have the sort of GPUs and compute access. And so they've all sort of designed around that. Right. They're, they're trying to do things that aren't that. And then in the middle there's this very, it's a fairly small number of companies but they're discrete that are like just below that, you know, sort of Microsoft funded level tier, but still kind of like leaning towards that direction versus you know, being sort of more the smaller types. And that's the, that's the segment of the market that feels most sort of ripe for culling let's say at the moment from where I'm sitting, totally, yeah.
I'll be curious which ones sort of end up having the same result. I think in when I stepped back. Inflection to me was very much an, it was an execution problem like the resourcing was I think generally there. They ended up building a model that was competitive even though it wasn't the best. It was very clearly in that first batch, as you were saying, that first tier of models that would look to match OpenAI's current release and sort of be in that we're all sort of one to two years behind OpenAI sort of category. Look, the problem is like you have a company like Mistral right next to Inflection that completely out executed from the model building front, right, Mistral, these guys are like, they're located in Paris. They just like show up like they raise a whole bunch of money and they're literally tweeting out the full download to their entire model, everything. And the model's very, very good, right? Like every time they release something, it is higher in the leaderboard. They're starting to compete with Facebook, with meta very effectively and that's really impressive, right? And so there's a little bit of like, I think when, when people were looking at Mistral, they were kind of also looking at inflection and being like, okay, well why can't they do the thing? You know, I mean they're like right in the heart of everything. They have all the right talent and leadership and researchers and all that kind of stuff. And these guys are just showing up and tweeting stuff and they're like building really competitive models, right? Like, why can't inflection do that? So I think there is, that there is this general question of like look, if you're trying to chase OpenAI and build these general purpose models, it might be too late. That window might be closed for the amount of resourcing, the time it takes to attract the talent, like all that kind of stuff that, that, that, that you need. The, the other sort of category I'm curious about is building these vertical specific foundational models. So I'm thinking about for example a company that raised announced a fundraise this week in partnership with Nvidia, which is called Hippocratic AI. They're building a foundational model for healthcare and they're starting with nursing. Right? Like that, that is sort of their application. On one hand I generally believe that, you know, that this approach is, you know, probably fruitful. You also have folks at Microsoft, for example, you know, I've talked to them and they say look, like maybe these general purpose models, maybe like the GPT 6, 7, whatever it is, just ends up being so good that you don't need vertical specific, you don't need fine tuned models. You don't just use the one big model that can do everything right. And the data point there that I think about is Bloomberg tried this. Like Bloomberg wanted to train their own Bloomberg specific finance model for financial literature mid last year. And then they did a retro where they were like, okay, well we built this model, we trained on all the stuff that Bloomberg has access to. World's biggest financial media company. And they compared it, they're like, okay, well what about this model compared to GPT4 with no sort of specific training around finance. And then it turned out that GPT4 out of the box did better than the model that they built. Right. And so this general question of just like look like, shouldn't we all just use OpenAI stuff? Like maybe they just get so good that we don't need any task specific or industry specific stuff. Stuff that is a valid question and I do think that it's worth trying all these things. Like it's not, I don't believe at all that these serps should not exist. But I'm curious to see what the landscape looks like at the end of the day. Is AI really just kind of like cloud? Right. Is it just going to be three big players? It's like sort of like an oligopoly. One or two players sort of stand out from the rest. But it's kind of like three that are like making the most money and surviving and have the competitive advantage. And if it is that, that's interesting. Right. And if it doesn't, and there actually is a sort of like wide base of models and a lot of competitors that is also interesting.
Yeah.
You know, so, so I'll be curious to see in again 3 to 5 years time how it all shakes out.
One of the things, it's a super fascinating conversation and as you were talking, one of the things that I was thinking about is part of the challenge for inflection is this is in retrospect, this is a hindsight 2020 thing. So I don't at all blame them. But they're actually quite uncomfortably in between chatgpt on the one hand and the character AI, down to the even less serious Candy and AI Boyfriend girlfriend thing where they might have been right in their instinct that people were going to want a personalized interaction with AI, but they didn't want the sort of like personal chatgpt. They just wanted characters. They just wanted, you know, like, I mean if you look at how many people are using these AI Boyfriend girlfriend sites, like it's crazy. The numbers, the numbers around character AI are unbelievable. So it might have been that PI's thesis was correct and it just was the wrong form factor. You know, they were too, too like close to like legitimate, at least for that early adopter class.
I think that's such a good comment. I, I love that you brought up character AI because I also don't think they're making money as far as I understand it. And it is these very rather niche behaviors, at least non mainstream behaviors, that are driving character AI's usage, I have no. I would love to see their financials and how much cash they're burning. I think when I step back, I think the general commentary by these founders is probably correct, which is everyone has this image of that movie her where it's like this thing that again, it's a personal thing and it's very consumer grade and is your therapist, partner, sort of friends, you know, teddy bear all at once. Right. That product probably should exist, frankly. Like there's probably going to be some version of that. We see. I think there's a lot of demographic and sort of earlier trends sort of behaviorally that point to that being a thing. But what we wrote in the Neuron about this is a good product does not mean a good business. Will people pay enough to sustain this business? We don't know like currently. Currently. No. Right. Is my, is my best guess, considering today that running these AI models is still very, very expensive and you would need to charge the same amount that ChatGPT or Claude or whoever charges for their products, which is they all charge 20 bucks a month. Right. And we have no idea if they're continuing to burn money, if that's just sort of a subsidy or if that's actually enough to sustain them. But it's going to be really hard to convince the average person to pay 20amonth for this AI sort of again, combination therapist, friend, partner, teddy bear type of thing. I wouldn't, you know what I mean? And I like playing around stuff and trying new things, but that's. That, that's 250 a year out of my pocket. Like I don't, I don't know that I care enough about that thing to pay for that experience. At least it hasn't shown me that that is like significantly better at this point.
Well, and you know, it's funny too. Just further playing this out, let's say that the assertion that their underlying thesis was correct but the form factor was wrong for inflection could also be the case for character AI. And that the actual sort of first beachhead for this are people who are, you know, that, that it's. That it's sex. Like the same way that normal, you know, Internet stuff starts. Right. That what gets people to whip out their pocketbooks is like a very different type of experience that's not just like, oh cool, I'm talking to Elon online. But it's like a whole different thing, you know, and that's where money changes hands in these early days, you know.
Totally, totally. It was funny because I remember as Character AI was blowing up and we were seeing those insane usage numbers, right? Like I think they were reporting like 2 to 3 hour average session times. I, I had the same reaction. I was just like what is going on here? Like there has to be something that is kind of like that driving everything. And of course when you went to the wiki on, on, on their subreddit and you were looking at all these like oh, how to use character AI, what is it? All that kind of stuff. They just had this one section even as early as back then, which is how to trick the character AI bot into talking dirty to you. You know what I mean? And I'm just like, okay, like this is non sort of insignificant portion of this usage probably. I don't know if it's all of it, right? From what I observe it's a lot of like anime community and like gaming community and all this kind of stuff which are big markets, they're quite big segments. I don't believe that's all sort of sex related but like there's a little bit of that motivation, right? It's at least a little bit enough to make it onto the subreddit wiki, right, that enough people were interested in this.
Yeah, it's fascinating. I think, I think that the, the best reflection on all of this is that it's very hard to know these things before they actually happen. Which is why I think, you know, from my standpoint, I like the, the, the inevitable wave of failures and consolidation that's going to happen with AI companies. I have a strong suspicion, and I think we have some evidence of this, that it will be presented by lots of outlets as evidence of sort of a move from a peak of inflated expectations to a trough of disappointment. Because it's such an easy, you know, hero's journey kind of narrative path. And I just don't think that it's actually going to represent that. I think it's going to represent a very natural process of consol. Like basically it's going to represent what capitalization and venture capital is supposed to do, which is fewer companies make Series A than got seed and fewer companies make Series B than you know, like and, but there's going to be, you know, over the next six months just hundreds of companies that fold or join or you know, because there's just, there has to be, there's too many, there's 15 versions of everything. That's a, that's, that's a potential business model right now.
Yeah, I think you nailed it. I think you nailed it perfectly. It is mathematically that is just why venture capital exists as an asset class, right? It is meant to fund these big moonshot ideas. And the vast majority are not going to work out. The vast majority are even going to look like this, right? Where we have again a good product, not enough to sustain the business, right? All that's going to be true. I remember a friend of mine had a conversation with a GP of a pretty prominent venture firm and they were saying how a lot of the AI SERPs that they funded are now struggling because it's so competitive, right? Like to your point, 20 teams in every vertical doing the exact same thing. The AI phone receptionist thing is a perfect use case where there's enough so many of them doing, oh, and AI will pick up the phone for you and sort of schedule meetings that even now they've only been around for like six months, nine months, whatever it is, they all have to specialize and position themselves as the AI receptionist for plumbers, the AI receptionist for dental practices, the AI. You know, there's just so many of them that you have to like choose that particular focus, right? And I think you're right. I think the media is going to paint it as this ultimate failure of like, oh, here we go again. Like the VC Bros have funded like yet another wave. Like they're going to try and make it very look very similar to crypto probably, but I think it's fundamentally different and it's just a matter of time. Like at the same time, as I see, as I hear a lot of startups that are sort of struggling to figure out where the product actually is, where actually is the opportunity given the competition. I also am seeing a lot of companies like identify very, very clear needs and they are backed by very specific workflow or industry knowledge that informs. Like they just know that there's like this particular thing that is exceptionally painful in financial services, in manufacturing and wherever and there there's maybe only two or three teams doing it, right? And they're sort of automating these like things that you and I have never heard about, these processes that we don't even know exist, those are real businesses, right? Those are going to be going to have a real impact here. So I think like on the consumer front, to your point, random as hell. Like consumer stuff is completely unpredictable. It's kind of like why does the social media trend blow up? I don't know, it just like kind of just happens, right? So I think we'll see a lot of that sort of washing out. And I think you called it perfectly. It's going to be this sort of of tech versus media thing yet again and then you know, in a couple years we're going to get out of the trough and then it's going to be at a properly level setting, not over high to level of adoption. And that's going to be when when Gold hits.
Great note to end on. Could chat about this stuff all day, but really appreciate you hanging out today. Pete. For those who have not subscribed yet, check out the Neuron. You will not be disappointed.
Sam.
More from LARRUZ


Ep 881: Faster AI Agents, Fewer Human Coworkers: The Overly Productive Future of Managing Agents? (Replay)


Ep 879: New: OpenAI Presence. Has The AI Customer Service Takeover Finally Arrived? (Replay)


Ep 878: What’s Coming Next: 5 AI Trends, Problems and Opportunities around the Corner (Replay)




