2 Ex-AI CEOs Debate the Future of AI w/ Emad Mostaque & Nat Friedman | EP #98
25 Apr 2024 · 51 min
Emad Mostaque and Nat Friedman, both ex-AI CEOs, debate where AI is headed. They discuss open versus proprietary models, how fast AI is advancing, and what it means for business and society.
Wouldn't it be great to manage your portfolio on one platform? Well, now you can trade all in one place on Robinhood. That means you can trade individual stocks and ETFs and also buy and sell crypto using seriously powerful and intuitive tools at one of the lowest costs on average without needing to manage multiple apps. Robinhood makes withdrawing and depositing crypto seamless. Send crypto to your Robinhood account or send crypto from your Robinhood account to other wallets without deposit or withdrawal fees from Robinhood. Trade all in one place. Get started now on Robinhood Trading. Crypto involves significant risk Crypto trading is offered through an account with Robinhood Crypto llc. Robinhood Crypto is licensed to engage in virtual currency business activity by the New York State Department of Financial Services. Crypto held through Robinhood Crypto is not FDIC insured or SIPC Protected network fees may apply to crypto transfers. Crypto transfers may not be available to all customers. Investing involves risk, including loss of principal securities. Trading is offered through an account with Robinhood Financial LLC member sipc, a registered broker dealer.
When did making plans get this complicated? It's time to streamline with WhatsApp, the secure messaging app that brings the whole group together. Use polls to settle dinner plans, send event invites and pin messages so no one forgets mom 60th and never miss a meme or milestone. All protected with end to end encryption. It's time for WhatsApp message privately with everyone. Learn more@WhatsApp.com what I think happened in the last year really is the starting gun was fired.
We spent a trillion dollars on 5G. Is AI more impactful than 5G? Of course it is.
Do we actually know what's going on inside the models?
We can measure everything and still we don't really quite understand mechanically what's happening inside them. They're not engineered and designed, they're kind of grown.
AI is clearly more capable than humans.
Now we know this is going to get better. When does it slow down?
Right now it's a few companies doing this, but we need standards around it and we need the expansion. And again, every country will invest in this. Every company will invest in this.
We're here to talk about what happened. I want to say WTF just happened in the past year because a lot has happened. Imad, you were on stage with me a year ago and things were amazing then, but a lot has happened. So I want to split this into a couple of parts like what just happened the last year and then I want to talk about how far forward can you see? What do you expect is going to happen? I'd love to talk about the companies, the models, the dramas. What did Ilya see? I think that's going to become a meme. Nat, do you want to kick us off? What's the big things that happened in the last calendar year in your mind?
Well, yeah, it's been kind of an amazing year, I do think, for people who just started paying attention to this sort of new AI and deep learning revolution in November of 22, when ChatGPT came out, things probably seemed very fast because we had stable diffusion come out over the summer. Previously in 22, we had ChatGPT in November and then just a few months later, GPT4 came out, sort of demonstrated a new level of capabilities that, you know, were shockingly improved over what was there previously. And so I do think there's a set of people who sort of extrapolated from those three data points in terms of the progress that was going to happen from there. And it's incredible actually how quickly people can adapt to these new things. And there was a point at which kind of chatgpt blew everyone's minds. And then a few months later it was sort of just something we accepted as part of the world, as part of reality, and we can very quickly enter this kind of slump. Where's the new model? GPT3? 4 is boring now. When do we get GPT5? Come on, Sam, put it out already. What are you waiting for? This kind of thing. So. So I think we had a little bit of that this year. And then over the course of the year though, what we started to see, and I'd been waiting for this for a while, but we started to see real adoption taking off. And so back in 2020, GPT3 had come out in 21, when I was running GitHub, we put out GitHub Copilot and it was, I guess, one of the first LLM commercial products. And I thought that immediately after that there would be this rapid wave of commercialization of large language models because developers would have seen how capable they were, what they could do and start building products with them. But it really took this kind of chatgpt moment before entrepreneurs, developers and product people started to do this. And so what I think happened in the last year really is the starting gun was fired on the actual exploitation of these raw capabilities, the building of products, the working of them into companies and organizations. And now that's what we see. The adoption's been incredible. ChatGPT is rumored to have gone from basically zero to $2 billion in revenue in just about a year. That's amazing. There's, you know, organizations like Stability that put out models that have, you know, hundreds of millions of users. You have, you have midjourney. You have now Google in the game finally with Gemini. I thought it was exciting to see them not only release Gemini, but very quickly follow up with Gemini 1.5. And so there's a way in which Google is clearly intern internalize the pace here and the need to iterate and ship. And so I don't think a lot.
Of people realize how far ahead Google was for a decade.
Yeah, right.
So Google had really developed a lot of the, the early tech here and said it's not ready for release. Right. They were being responsible to a great degree. And then, and then how do you not release after ChatGPT goes gets released?
They're shipping tilts now. They're going to ship.
They're going to ship. Yes. Imad, the open model story that you told us last year has really blossomed and in fact it's become sort of an ethos in the organization. Right. It's Elon is like really twisting the knife in with Sam and then says, but Grok's going to be open now. Can you talk about what's happened in the last year in Open Will Open win, do you think? And I'm curious for both you guys and describe what open is versus Closed for the audience here.
Yeah. So proprietary AI is. You don't see the code the way it's anything and it's provided as a service. Whereas open models and code are ones that you can adapt yourself, you can take, bring to your own data and you own. And that's important because these models are something a bit different. They're like extensions of our mind. And so the best analogy I've said is that these are actually like graduates. So they can code, they can write, they can sing, they sometimes go a bit crazy when they try a bit too hard. We'll give them better education. And so open models are like graduates that you hire. And then proprietary models are like consultants you bring in.
Interesting.
And in the early stages, we all needed consultants. Now people are saying, well, I want this for my own data, I want this for that. And Open allows for innovation to happen. So we've had now 330 million downloads of our models on hugging face.
Wow.
So we just.
And what is hugging face for folks?
It's GitHub, but for AI models, so it's where you Go as a developer to download the models. And so people, millions and millions of developers are using this technology. But then you look at the language model side, people are taking it, adapting and optimizing it to have innovations that now catching up with even proprietary guys. But they're complementary. You will have your own team and then you'll bring in the specialists. And I think that's the best way to think about this. Because you can't outsource your internal intelligence from a personal company within country level to models that you don't know what the provenance are. And this is one of the debates that we saw over the last year. The first step was like oh my God, exponential extrapolation as Nat said, kind of actually the foundations for this were dug like maybe a decade ago and now we've been filling in the cement and now we're all building houses and we're like, well the houses have become skyscrapers. So it was like, well they could kill us all and those. And those are valid things to discuss. Then it became about sovereignty and well, GPT4 is amazing, but I want my own version as well for my own private data. And so I think as we advance, proprietary models will always beat open models.
Proprietary will always be what?
Open models because you can take the open model and bring your private data to it and optimize it. Because open models are like generalized graduates, as it were, but both of them need to exist. I think we'll see both of them continue to take off.
Do we actually know what's going on inside the models? I was listening to a conversation with the chief scientist at Anthropic who will be on stage with us next year and he's saying we actually don't understand really how these models work. Is that a fair statement? Yeah, I mean, just so you understand. All right, it's like they're amazing, but we actually don't understand how the weights and connections and all are really working.
I mean we understand it at this very micro level. You know, we can see the multiplications happening and we can see the signal moving to the next layer in the neural network. But it's actually sort of similar, although not the same mechanisms to the way. We don't have a perfect understanding of the way thinking happens in our brains. We don't. Even though in the case of our brains, when we try to do the neuroscience and understand what's happening at the neuron level and the organelle level, we're limited by our measurement. Right? We can't measure the state of every Single neuron in your brain while you're thinking that would. That's not something we have the sensing technology to do now. That's not a problem we have with these AI minds that we're building. We can measure everything and still we don't really quite understand mechanically what's happening inside them. They're not engineered and designed, they're kind of grown, you know, they're the products of us actually, because we have the Internet, which digitized the world and put the sort of all the data we've produced online. And there's a way in which that process of building the Internet was like a bootstrapping process for building AI, because it was a precondition to making AI. We digitized the world, we put all the contents online, and then we could use all that to sort of grow and train these AI models, but we don't quite know how they work. Now there's a new field, new not in time, but relatively small field called interpretability, which is about trying to understand what's going on in these things. What are they doing, how do they make the decisions that they make? Obviously there's benefits if you can do that to making them better in all sorts of ways. You can make them smarter maybe and make, make better decisions. And you can also hope to make sure they do the thing you want them to do and not, not something else. But it's new.
Elon put a tweet out, which I read during my opening remarks, that said, by 20, yeah, we're going to have human level AI next year, and by 2029, AI will be equivalent to all 8 billion people. Do you agree with that, Imad? Do you think it's going to move that fast?
I think we had a big discussion about generalized AI that can do everything. And that was the focus of DeepMind and OpenAI. But for specific tasks, AI is clearly more capable than humans now. So for example, Google's Gemini Ultra model has a million, 10 million token context window. What does that mean? It means that someone can upload themselves debugging a piece of code in the code base and it'll correct it. And no human could ever do that. You know, RAM isn't big enough, you know, on image now we can generate images faster than anything. Songs in seconds and other things.
Let's talk about that a second. Sora was, I mean, pretty like, holy shit moment, right? And someone is doing it right at OpenAI with ChatGPT and then Sora. But I remember last year you told us it used to take like 30 seconds to generate on stability a single image, and then it was down to a second. And you've advanced the technology orders of magnitude since then.
Yeah. So I think if we can put the thing up, put up the slide.
Stable image.
Yeah. And then if we actually go to the next slide. Talk about speed here.
Should I click this? Let's see.
Oh, you can click this to give an idea of where it's gone. So image was kind of one of the things that kicked this off in 2022. All of these images can be generated on a MacBook. On a MacBook, just from description. And now we've perfected text and other things. But the next step after you can generate all these beautiful images is that you, you want to move to control. So the models are just the first step. You have to have ChatGPT and other things to make them useful. But then you want to be able to take that guy and say upscale. And that's all we said and upscaled him. You want to say, replace a lion with a cat. And we can now do that real time. Or tiger with a unicorn. Replace background with a forestry forest. So all of this you can do pretty much real time. Because if you look at the next slide from this. Okay, I said it was 20 seconds to one second. This is live real time. You can just type and it automatically adjusts the cat. It gives him a hat. But then if you look at the optimization of that with the next slide back one. We missed it.
This one.
Okay, well, we missed it. Go back one, slide. Sorry. With this process here, we're just releasing a new distillation model today. We've got it to 200 cats with hats per second.
200 cats with hats per second. So that's your speed of image generation. That's a new unit image generation.
50 milliseconds per image.
Yeah, exactly. Because there's not enough cats on the Internet. Right. So we're going to add more cats. The Internet.
Oh, five milliseconds. Five milliseconds.
Five milliseconds. Yeah. But I think with the new chips that are coming, Nvidia is going to announce another one. We'll get up towards 1000 images per second.
So that's real live. That's live video times 30.
Yeah. And so OpenAI's innovation, there were two major things. There was a transformer architecture of the language models and diffusion that drive the media models. They combined the two together. So our new image model, stable diffusion 3, which is the best performing image model, combines those together as well. So if you go forward a few slides from here.
Next one.
Skip another one. Another one. That's the upscaling.
So you basically said, upscale this image on the left and you get the image on the right.
We'll have that real time in a couple of years. So your boxy video games will look a lot more realistic.
So just literally as you're. You can take an old game and play it in surreal life.
Yes. But if you go to the next slide, these videos with our video model were all generated on a consumer graphics card with five gigabytes of vram.
So, I mean, the point is, this is in everybody's hands.
It's in everyone's hands. And again, we haven't even optimized the data. So in an hour, Next slide. We're releasing the world's most advanced 3D model. So all of these are generated just from descriptions. And so the fastest version of this does it in one second. So you can generate that dragon, but then the next step is you'll be able to control every element, make its horns bigger, make these adjustments. So how long would that take for a normal creative person in kind of industry, a huge amount of time. But now it works on the edge and it works even faster in the cloud.
So a future here where you can be describing the video game you want created. And it's generating all the characters and generating the play.
Yeah. And so if you go back a few slides to that thing with all the nodes, I think this is an important thing. Sorry, I didn't do the slides properly. I think one of the things that we're having right now is this is a system we built called ComfyUI, that's used by just about everyone now. So you take the face, the pose, the dress, and then you have the output. But if I share that image with you, it reconstructs the entire flow. Because last year was the year of creation. Models that create then ChatGPT, ComfyUI allowed you to control and compose them. And the next bit is bringing that all together. Because ChatGPT, all the knowledge that you build from writing your speech, you don't have files anymore, you have flows with these models and assets there. I think that's the next step, because when you go beyond just spitting out ideas to be able to control them like that, that's a huge deal.
Amazing. And you're announcing this in an hour.
The 3D model's releasing in an hour, open source to everyone.
Give it up for IMOD here. You really have, and I don't know if you're able to say this, I mean, you're driving revenue and soon at profitability. What's your financial.
I can't say that publicly.
You can't. Okay.
But it's going well. We're ahead of forecasts, as all I can say.
All right.
He told me backstage it was good.
Yeah. Okay.
Yeah.
Everybody, I want to take a short break from our episode to talk about a company that's very important to me and could actually save your life or the life of someone that you love. Company is called Fountain Life, and it's a company I started years ago with Tony Robbins and a group of very talented physicians. You know, most of us don't actually know what's going on inside our body. We're all optimists until that day when you have a pain in your side. You go to the physician in the emergency room and they say, listen, I'm sorry to tell you this, but you have this stage three or four going on and, you know, it didn't start that morning. It probably was a problem that's been going on for some time. But because we never look, we don't find out. So what we built at Fountain Life was the world's most advanced diagnostic centers. We have four across the US today, and we're building 20 around the world. These centers give you a full body mri, a brain, a brain vasculature, an AI enabled coronary CT looking for soft plaque, DEXA scan, a grail blood cancer test, a full executive blood workup. It's the most advanced workup you'll ever receive. 150 gigabytes of data that then go to our AIs and our physicians to find any disease at the very beginning when it's solvable. You're going to find out eventually. Might as well find out when you can take action. Fountain Life also has an entire side of therapeutics. We look around the world for the most advanced therapeutics that can add 10, 20 healthy years to your life. And we provide them to you at our centers. So if this is of interest to you, please go and check it out. Go to fountainlife.com Peter When Tony and I wrote our New York Times bestseller LifeForce, we had 30,000 people reached out to us for Fountain Life memberships. If you go to fountainlife.com Peter, we'll put you to the top of the list. Really, it's something that is, for me, one of the most important things I offer my Entire family, the CEOs of my companies, my friends, it's a chance to really add decades onto our healthy lifespans, go to fountainlife.com Peter it's one of the most important things I can offer to you as one of my listeners. All right, let's go back to our episode. I am curious about the idea of how far are we from having an AI that I can have a conversation with and say, I'd really like to create a new business that does this, this and this, and just have that, like a brainstorm partner AI and it will do the incorporation, it will write the code, it will generate the marketing materials, and it will be able to, you know, we're all entrepreneurs here. That's all we, you know, find a problem, build a business. Find a problem, build a business. How far are we from that reality of an AI created? Well, I'll come back to the second part in a minute, but an AI that can be your thought partner and really staff up a company, I think.
It'S already happening gradually and then maybe suddenly we have, I think companies will. These models are neural. They're neural networks. And so I think the right way to think about it is that companies in the future will just be increasingly neural and there will be more and more of the company and what used to be the departments of the company that are single models or swarms of models that are doing work. I think it'll, you know, at some point, probably very soon, we'll look back on 20, 24 and say, God, do you remember when companies had like hundreds of people in the finance department doing accounts payable and just like transforming information from one form of text to another, essentially, and doing this coordination. And so I think you will have some form of both existing companies that just adopt more and more AI because it gives them advantages, it makes them more efficient, maybe it gives them better customer service. People enjoy the responsiveness, intelligence, politeness, clarity, et cetera of the AI counterparty. And you'll also have new companies that'll be AI native, started from scratch, neural from the beginning. So some people may remember when Insta Instagram was acquired by Facebook for a billion dollars, everyone was just marveling at the fact that a small company, 13 employees, 13 people, could be worth a billion dollars. How is that possible? And the joke was, you know, gosh, could you ever get down to a one person company that's worth a billion dollars? And, well, like, this is clearly going to happen maybe eventually, zero person company.
So we talked about this getting ready and I said, when are we going to have a scenario where a government and we have some governments in the room here says we're going to create a new regulation that allows an AI to incorporate on its own in our jurisdiction. I think it's a winning scenario because all of a sudden the AI incorporates, you get the tax base and every AI incorporated company will move there.
I think Wyoming's done that.
What's that?
Wyoming's done that. They have a new structure called a DUNA for a decentralized autonomous organization.
I'm sure.
Who has Wyoming. Wyoming of all places.
Yeah, we have some Wyoming fans here in the audience.
Yeah. So technically that could happen today.
Amazing. I mean, I do think that that is a. So the speed of wealth creation. How should. So let's talk about what are the wow moments that might be possible in the next year? What are some crazy wow moments that you might see?
I think one of the most important things is the accuracy. And then these long context windows explain.
What the long context window is again.
So you're absorbing information right now and it's quite high definition because you can see everything here and other stuff, but you're still writing it down. And the reason our organizations get big is because text is a lossy transmission format. We lose so much context. The final PDF loses all of that stuff. Now with the new Google models, NAT has some amazing companies in this space as well. You can upload hundreds of thousands of words, thousands of documents, and the AI can interpret them all at once. That doesn't need to be trained on it. So you can upload all of your ideas and say build a business based on this and it will do that. Or you can upload like a whole bunch of movies and then tell it to write a script that incorporates all of that and it will do that inference time. That again is something superhuman. But we all have these massive repositories of all these ideas we've had. Being able to dump that now and then the AI without having to be trained, spit back answers, ideas and things like that I think is a really huge step along with that composition step that kind of discussed before.
Yeah, I totally agree with that. I think there will be a couple things coming probably pretty soon. It's hard to predict exact timelines on these things. Sometimes things happen faster than you expect and sometimes a little slower. But one of the clearly amazing, clearly possible now products to build is a voice to voice model that's indistinguishable from talking to a human. Maybe for a conversation of up to a couple minutes where what happens after.
A couple of minutes?
Well, maybe you can kind of just Tell somehow that it's not quite human. After a couple of minutes, I'm setting a milestone that I think is achievable this year. Maybe if you can do two minutes, you can do 12 minutes, I don't know. But yeah, it's actually about all the technology is there. It all just has to be integrated. And so you need the sort of the ability to recognize speech is there, the ability to interpret it with a language model and generate responses is there. And then the ability to turn that text into incredibly realistic voices there and kind of putting that all together into a package that has very low latency, that's talking the way we talk, where you can kind of interrupt me and maybe there's an avatar that's giving you this human. Like, I mean, Aristotle was very impressive, but I knew that that was not a real person. And so I think we could.
He was a real person.
Yeah, that's right. And then I think the other thing that's a very big deal is this idea of autonomy and agents. There's been a lot of talk of it with AI over the last year. Today, these things are not agents, they're tools. They're call and response. You go to ChatGPT, you type something, you hit enter, you watch the response kind of stream back. And I think what people don't necessarily understand is that when these language models are responding to you, it's almost like a rap battle. They have a fixed amount of time to generate each word, and so they can't sort of sit there and ponder for a minute what they're going to say. They have to talk to, to a metronome. And so that's why when you see the words that they're writing out, that's not like they've thought about it a lot. And then you see the words, it's actually the thinking is happening during the output.
Would you say that's how a human does it too? I often, I mean, a lot of times sometimes I'm really pissed off at what came out of my mouth because I didn't think about it in advance.
Yeah, I think so. I mean, sometimes you have a conversation with a smart friend and you just forming the words to respond, you have a better idea. And so I think we definitely do that too. But the agent, the autonomy is about kind of increasing the unit of work you can trust the AI to do without making a mistake. So right now you can ask it one question, get a response, you interpret it, you figure out the next thing. But what if it could go do 10 or 100 steps. You were talking about an AI business. Do you trust it to come up with the title of the blog post that you're going to post or do you, do you trust it to actually come up with the whole idea of the marketing campaign? Right. Come up with the strategy for how to execute it, all of the content it's going to generate, the partners it will reach out to and negotiate advertising or whatever it's going to do, have those conversations multi step successfully all the way to like measuring its results without supervision. And I think that agency thing, we're starting to see it in programming, there was a very impressive demo a week or two ago of a company called Cognition that I think it was maybe it was arguably the first really impressive demo of working agents in AI. And they did it with GPT4. So not with a new, brand new model. They did it by being very clever about the way they squeeze and distill the intelligence out of GPT4 by repeatedly calling it and analyzing and evaluating its results and choosing the best way to. And so sort of going from rap battle to like draft and redraft and sort of think and ponder about it a little bit harder mode and it can do hundreds of steps in programming successfully.
So I think you might. Okay, I was going to ask you one quick question then please jump into that. How far out can you imagine right now?
About three years.
Three years is a max. Yeah. How about you, Nate?
Well, you can dream. You can dream. Yeah. So I actually the thing I find easier is to think about the long term because.
The asymptote of where.
Yeah, and that's the key question of our time is the asymptote. It's like we know this is going to get better. When does it slow down and what's the shape of the curve to get there?
Imad, I cut you off. Apologies.
No, it's fine. I think probably the thing to look forward to is the last couple of years. The first year was about the technology and the breakthroughs in the research. Last year was about the models. Next year going forward, no one give a damn about the models. It's all about what you can do with the models, bringing them together. Because the models have satisfied, they've got good enough, fast enough and cheap enough, they will get even better. And there's probably two orders of magnitude improvements still in the speed and reliability of the model. But this will really become about. And the stories of the next year will be about we use this model to do this and it was amazing. You Know, and so I think that's one of the things to look at. And that's what Nat said about tying them all together. You've got the ingredients, now what are the recipes we're going to make very.
Quickly, capital and regulation. I was in a conversation with the CEO of one of the major AI companies and just he was saying he's raising 3 billion. And I said, you know, I have a venture fund. I said, great. And, and I said, what's your minimum? And he said, Probably 100 million. I said, okay, well that's out of my ballpark, but, and, and how quick do you think I'm you're going to raise it? And he goes, next month. I mean there is a lot of capital flowing in.
Yeah.
I mean, have you ever seen a capital rush faster than this?
No, no. I mean, I think there are a couple of comparisons you can look at. I think the railways, when railway infrastructure was being laid in the uk, I think it was some double digit percent of GDP investment. I think the solar explosion that's happening right now is actually pretty amazing. It's something like half a point point of global GDP is being invested in solar. So those are pretty big. We're nowhere near that yet with AI. And so I actually think if AI keeps working, which it seems like it will, you should expect the future to look more like that railway or solar situation where there's. You're measuring the investment in intelligence because it's so valuable. Intelligence, AI is intelligence. Intelligence, intelligence is power. Power is valuable. It's power over nature, it's power over others. And so you'll probably measure the amount of investment in it in points of global GDP. And whether that happens in two years or 10 years, I'm not sure, but it seems likely.
I mean, to put this in context, less money's been spent on private AI companies than the Los Angeles San Francisco Railway. That hasn't started yet.
There you go.
Wow. Right.
But that's almost done, I heard.
So really fantastic. They haven't even started.
We wrote down on it.
The AI. AI right now is an infrastructure, but it should be.
Which is why talk about your vision there, because I find it very powerful, your vision there in education, in health. Talk me.
This is a next generation human operating system because these AIs extend our capabilities. And again, you'll need the AIs that open and the ones that are proprietary to have the best outcome for everyone. Because all of our companies here are all information systems and we've seen how bad it can be. So the Total amount of spending in this will be trillions of dollars. We spent a trillion dollars on 5G. Is AI more impactful than 5G? Of course it is. Should it be infrastructure? Of course it should be. Should the data be transparent? Of course it should. Because you need to know how our railways are made. The information knowledge superhighway of the future. Right now it's a few companies doing this, but we need standards around it and we need the expansion. And again, every country will invest in this, every company will invest in this. I mean, is anyone here who runs a company not investing in this in.
Some way at least your time, right?
Yeah. Multiplied by every company in the world.
Where are we percentage wise at the investment in AI? Are we at a fraction of 1% still?
I would say so, yes.
How about you, Nate?
Seems likely.
So a lot of upside still. Opportunity.
It is crazy though. I saw a tweet the other day, I mean I live through dotcom and all these little tech bubbles and I saw a tweet the other day from someone that said if you don't secure equity in an AI startup now, then your children will be chattel slaves for the machine God for all eternity. And I remember thinking, I don't remember anyone saying that during dot com.
And then he switched around and bought some more GPUs.
Right. This is somehow a little bit more extreme than the prior bubbles.
So I mean, Look, I think Web3 kind of received a lot without any results, whereas now you're seeing impact here. Yes, but again, you multiply this by the number of people, it affects the value created. It's insane because it will go orders of abstraction. You've had the base, the foundations, now the base. Now you're building the houses, you're building a whole ecosystem around this and the transformation that that has. And the amount of capital is bigger than anything we've seen.
Let me ask the question we're going to be debating today on the asymptote. How concerned are you about digital super intelligence? I'm defining this for a purpose of conversation as AI, a billion fold more advanced than the human being. How do you think about that? What's your position in that debate? Pro con, any way you want to kick off.
My belief is that humans can break the atom or we can go to Mars. And so my vision is every single nation, person, company, country, culture has their own AI data sets and self sovereign needs to figure out the governance of this because it's important. And then that AI is our collective intelligence, it's the human Colossus. So it isn't controlled by any one individual, isn't embodied like that. But again, it's amplifying all of us and it's solving every single problem that we can have. I think that's a positive version of the future.
I think it seems really likely that, I mean, it seems undoubtable to me actually that intelligence is just a material process like muscle strength. We have organs called muscles, we use them to move. We have an organ called the brain and we use it to think. If you just sort of ask what that means. Well, we've managed to exceed muscle strength with artificial. Artificial machines. With machines hundreds of years ago. And we're going to do that with brains too. We're going to have artificial minds that are much more powerful than ours. It's almost like you just have to be an AI doubter not to believe that, or you have to not believe in human ingenuity. All the most brilliant people in the world are now working on this and there's a huge amount of capital going into it. And in a way we've just started and so the idea that it wouldn't improve seems hard to believe.
Did you know that your microbiome is composed of trillions of bacteria, viruses and microbes and that they play a critical role in your health? Research has increasingly shown that microbiomes impact not just digestion, but a wide range of health conditions, including digestive disorders from IBS to Crohn's disease, metabolic disorders from obesity to type 2 diabetes, autoimmune disease like rheumatoid arthritis and multiple sclerosis, mental health conditions like depression and anxiety, and cardiovascular disease. VIOME has a product I've been using for years called Full Body Intelligence, which collects just a few drops of your blood, saliva and stool and can tell you so much about your health. They've tested over 700 individuals and use their AI models to deliver key critical guidelines and insights about their members health, like what foods you should eat, what foods you shouldn't eat, what supplements or probiotics to take, as well as your biological age and other deep health insights. And as a result of the recommendations that VIOME has made to their members, the results have been stellar. As reported in the American Journal of Lifestyle medicine. After just six months, members reported the following. A 36% reduction in depression, a 40% reduction in anxiety, a 30% reduction in diabetes and a 48% reduction in IBS. Listen, I've been using Viome for three years. I know that my oral and gut health is Absolutely critical to me. It's one of my personal top areas of focus. Best of all, VIOME is affordable, which is part of my mission to democratize healthcare. If you want to join me on this journey and get 20% off the full body intelligence test, go to viome.com Peter when it comes to your health, knowledge is power. Again, that's viome.com Peter here's the challenge. It feels like potentially winner take all scenarios where if all of a sudden my company is able to utilize the most advanced AI and build out the next generation of systems and I'm doing it with me and my versions of Haley and Aristotle that they're working 24 7, I'm feeding them as many GPUs as possible and I have a chance to really outrun the competition. And it used to be that in the early days of the mechanical world, if you were using mechanical systems to outrun the horse, that was a local phenomenon, right? But now this is a global phenomenon because my, my bits are reaching around the world and you know, when you say yeah, it can do my marketing, do my marketing campaigns, it can do my scientific analysis, it can do everything. And you know, I keep on hearing that is like not 10 years from now, not five years from now, but that's like a three year scenario. I don't know how to think about that.
I think the pace of change is going to be very high and global GDP growth has been kind of in the 2% range. And we have a society and civilization that's able to adapt to that amount of change per year. Mostly not entirely. It's been a little bit higher before. Maybe it's going to be much higher very soon. And whether there's a huge spread of outcomes that come from that, I mean, even if you don't have the extermination scenarios, the extinction scenarios in mind, I think you actually should have other scenarios in mind. What does it mean to be human? Is the economy human dominated 10 years from now or 15? Where are decisions made and, and who makes them? And then just this vision of sovereign AIs. It's a new level of potentially cooperation and competition between countries and sources of this kind of power. And so a lot of changes coming. I think you should. I think we went through this before. We had the sort of five big inventions of like the 1880s to, through the 1920s and the. That was a wild time of transformation. It's like almost unimaginable. People who grew up with horse carts ended up riding on jet planes and we're going to have at least probably much more than that amount of change happen this time.
Let me go to you Imad next. But when you were about to go after this to part two of that tool and I want you to be thinking about how can AI help you solve the challenges you listed? How will AI threaten the dominant positions or the strengths that you have? And how will AI this year help you meet your 2024 goals? That's the goal to putting it to use. You might want to comment on that. And I want to also talk about medicine and you're dedicated to using AI models to solve autism and cancer and death. Or let's just say signals.
Yeah, signals. Yeah. I mean I just had a thought actually, you know, we had Steve Jobs quite earlier. Maybe the AI is jet planes for the mind.
Right?
There you go, here we go. But the kind of the impact here, there's a sociological impact, we can extrapolate forward, but an ASI is just something we can't think.
If you've got infinite advanced superintelligence, if.
You'Ve got two infinite space graduates, what do the existing graduates do? If the floor is raised, you don't need to hire as much. You become more efficient. What are the new jobs of the future in a knowledge based economy? We have to think about that because as Nat alluded to, it's like slowly, slowly, then all at once, like a turkey, you know, at Thanksgiving. I think if you look at this though, there's the negative side, but then there's a positive side. So I think mentioned kind of Last year, Google's MedPalm model outperforms human doctors in medical diagnosis accuracy, but also empathy. And we have medical models like that. Anyone here who's had someone who's had multiple sclerosis, Alzheimer's, autism, something like that, you don't have comprehensive authority to up to date knowledge and nobody to guide you through that process and you lose agency. Well, guess what? We will make open source models and they'll be available to everyone and you'll never be alone again through that. And then they'll be used for diagnosis and organizing all in large.
Describe that a little bit more so people can feel what that feels, feels.
Like it means again, anyone's experienced that. Someone comes to you and says you have a diagnosis of Alzheimer's for your father or autism for your child, you lose agency because you're like what now? There's no cure, there's no treatment, where do I even go for information? A lot of our stuff is a coordination issue. Whereas if we have a specialized medical model for that topic and retrieval, augmentation and tie it into all these systems, you can have all that knowledge at your fingertips and it can help guide you empathetically through that. It can literally talk to you, it can connect you with other people going through the same process. And then the next step is it can organize all the knowledge in this area because there's so many promising treatments. But how does anyone here find out all the treatments about autism or cancer?
There used to be patients like me, but it hasn't survived. But this supercharges that and then you.
Do that once and it's infrastructure for the 50% of people around the world that have a diagnosis of cancer. And again, you've transformed it because there will always be someone with every single person that can connect them to the right information at the right time. So this is the positive view of the future. And that creates boundless new potential in terms of both addressing our health, but science. And again, most of our science is based on files, a PDF and we throw away all the stuff that doesn't work. If you look at that knowledge flow of that image with the different things, and again, if I drag and send you that image, it will reconstruct the whole whole flow. I think most of our things will go from files to flows so we can remix our knowledge so that we can find out what works and what doesn't work. And that's how we get breakthroughs.
And is it true that most of the large language models were built on top of all the social media, Facebook, websites and so, but not crawling science magazines and most of the scientific databases out there.
Science was a part of it. But again, what we did is Big Compute was a substitute for bad data. It was like cooking a steak for too long. Now we see that high quality data is even better, but we're only understanding what high quality means. And this is why we need specialized models which are transparent, especially for things that affect things like health, education and others. So I think data set transparency will be a big deal. And this goes to Nat's point about interpretability as well. Like you were given that example of archive earlier, right?
Science. One of the things that I think is amazing is the potential for these AIs to help us discover new science beyond interpolation or extrapolation, new laws of physics, new understandings of fundamental biology and chemistry. Do you think that is possible? When are we going to see that and speak one second to the Vesuvius challenge that you.
Oh sure. Yeah, I think definitely they will.
Which by the way, for me is like the most exciting thing. If you unleash these AI models and say go and create room temperature superconductors, go and create life extension processes.
So there's in biology, especially biology, there's this sort of analogy that's been put out there that the language of physics was mathematics. The language of biology might be machine learning because you're dealing with enormously complex systems systems. Machine learning is great at sort of understanding those. And so the potential for AI to transform biology is enormous. I think it's all in the very earliest stages right now and we have not yet had the kind of GPT3, let alone the chat GPT moment for biology. And I think it'll come.
Since Google is our sponsor, I say.
The Gemini moment, there you go. The Gemini moment hasn't occurred yet. The bard, is it the Bard moment? Maybe. I don't know, but it's coming. And you know, I'm involved with some companies that are training enormous models to help synthesize and design proteins. There are a few great efforts out there to do this and the capabilities that are popping out of these things are incredible. The ability to describe a target, describe a structure and just have it produce a sequence of amino acids that you can then synthesize and test in the lab for safety and efficacy. It can short circle circuit a huge part of this sort of cognitive work and experimental work that's been necessary historically for drug design. And so I think that's one thing. I think another thing is there will be a surge of new discoveries that happen as AI digests all the existing scientific literature. And so there's a whole area of study which is meta analysis, where people will study across papers to find connections and correlations across existing research that haven't been noticed.
I mean, I'm bubbling with excitement on that notion and that idea.
Yeah, so imagine, you know, I have a friend, Shana Swan, she's a scientist at Berkeley and does a bunch of research on environmental toxins. She spent two years running one meta analysis that, you know, I'm now working with her and trying to support her in the effort to use AI to automate this. And it'll, I mean, in theory, with these long context windows, this could potentially happen in minutes. And so I think new discoveries will pop out of that immediately just because.
We'Re short on time. I'm going to say you found Mount Vesuvius after the eruption, buried a number of parchment scrolls that were, if you imagine, buried under all of the ashes and soot and so forth. You took some of those scrolls, you X rayed them, gathered the X ray data from those scrolls, and then you ran an order of a million dollar Vesuvius challenge, like an X prize. And the winner solved it.
It worked. Yeah. No, it's true. So, yeah, 2,000 years ago, Mount Vesuvius erupts. It buried the town of Herculaneum under 65ft of ash and mud. And then in the 1700s, some farmers digging a well found the villa at 65ft down. And then later, during these tunneling excursions, people kept running into these little chunks of charcoal. They didn't know what they were. They turned out to be carbonized papyrus scrolls that were not openable physically. They just sort of turn to dust in your hands when you open them. They've been stored in a library in Naples for years and we used a particle accelerator to scan them at super high resolution. But then we needed to use AI and machine learning to unroll them. They're so badly destroyed, distorted by.
How cool is that? Iman, why don't you close us out here with what you're most excited about going forward? What's a vision of the world in the next one to three years that you want people to take away from here?
I think this AI is augmenting, not replacing. And so you see what kind of Nat said and I look how creatives use it. I can't do art, it can do content right now. But you can use it to riff and jam with so you're in flow more often. So the thing I'm most excited about is its impact upon education science over the coming years because everyone will have access to all the knowledge that amplifies them. I think things like creativity are also great because it's great to create. But realistically, again, every single person in this room will just have access. This is the worst it will ever be.
That's so important. This is the worst AI will ever be. And the lowest bitcoin will ever be too.
Yeah. And then view it amplifying yourself and there's nothing you can't achieve with this. I think.
People are sitting down here with goals for the year, objectives they want to achieve. What is your top piece of advice for the CEO, entrepreneur, philanthropist here that has like, oh man, I'm trying to do more and more. What should they, what should they think about?
Well, I think what's happening or what's about to happen is sort of like we've just discovered a new continent with 100 billion people on it, and they're willing to work for free for us. And you should probably factor that into your plans over the next few years because your competitors will. Because it'll benefit you enormously at home, at work and your family.
We just discovered a new content with 100 million brilliant workers willing to work.
100 billion. They're gonna outnumber us?
Yeah, yeah, 100 billion.
And they'll work for a few watts of power. And so this is a good scenario and I think it's very, very likely. And so I would. And I think this is sort of like being an Internet native. You want to be an AI native and you want to spend time using this stuff and not looking for the problems, but looking for the value and how to. What's it good at? What's it not good at? How do you interact with it? It's amazing to see people use stable diffusion, for example. You've improved it so much over time. But there's a skill to being good at interacting with these models and partnering with them. And so I think we all have an advantage just to get that hands on ourselves. You know, imagine being CEO of a company when electrification was happening and obviously every company should electrify and then not doing it in your own home like that would be strange.
Amazing. Imad, you're going to be with us for the next few days, so thank you so much for that, Nate. It's a pleasure to get to know you. Thank you for joining us this morning. Let's give it up for Nate and Imad Sa.
More from Carlo
Financial Expert: Passive Income Is A Scam! Post-Traumatic Broke Syndrome Is Controlling Millions!
The AI War: OpenAI Ads & Sora 2, Grok Partners With US Government & Google’s Ad Business is at Risk w/ Dave Blundin, Salim Ismail, & Alex Wissner-Gross | EP #198
Atheist vs Christian vs Spiritualist: The Paperclip Problem That Exposes Religion!
The Latest in AI: Job Loss, Elon & Sam Altman Chip Race & the "AI Bubble" w/ Brian Elliott (Blitzy), Emad Mostaque & Dave Blundin | EP #197
Secret Agent: Never Be Yourself At Work! Authenticity Is Quietly Sabotaging You! - Evy Poumpouras
Replit CEO on Vibe Coding and the Future of Software Development w/ Amjad Masad, Dave Blundin & Salim Ismail | EP #196
The Insulin & Heart Doctor: The Fastest Way To Burn Dangerous Visceral Fat. This is How Insulin Is Quietly Clotting Your Blood! - Dr Pradip Jamnadas
NVIDIA & the US Government Just Bailed out Intel, Sending the Stock Soaring w/ Dave Blundin, Salim Ismail & Alexander Wissner-Gross | EP #195