The Real AI: Unmasking the Hype | Kevin Surace
19 Jul 2023 · 53 min
A James Altucher podcast episode featuring Kevin Surace (AI pioneer). They discuss AI's history (rule-based systems, hidden Markov models, Siri origins), the transformer revolution and GPT, compute/data needs and supervised fine-tuning, and realistic near-term impacts: productivity boosts (e.g., Copilot, design tools), industry shifts, cybersecurity and deepfake risks, verification challenges, and limits of near-term sentience claims. The conversation frames AI as an amplified/augmented assistant rather than an autonomous existential threat.
Chapters
Being an Entrepreneur is a 24, 7 job and when you're hiring, you need a partner that works as hard as you do. That hiring partner is LinkedIn Jobs. When you clock out, LinkedIn clocks in. LinkedIn makes it easy to post your job for free. Share with your network. Get qualified candidates that you can manage all in one place. For one thing, there you could post a job. LinkedIn's new feature can help you write job descriptions and then quickly get your job in front of the right people. You get qualified candidates. At the end of the day, the most important thing to your business is the quality of the candidates. And with LinkedIn, of course, you can feel confident that you're getting the best. Based on LinkedIn data, 72% of small medium businesses say using LinkedIn helps them find high quality candidates. Find out why more than 2.5 million small businesses use LinkedIn for hiring today. Find your next great hire on LinkedIn. Post your job for free at LinkedIn.com altitudure that's LinkedIn.com altitude to post your job for free. Terms and conditions apply.
This message comes from capital1. The capital1 venture X Business Card has no preset spending limit, so the card's purchasing power can adapt to meet business needs. Plus, the card earns unlimited double miles on every purchase. So the more a business spends, the more miles earned. And when traveling, the VentureX business card grants access to over a thousand airport lounges. The venturex Business Card what's in your wallet? Terms and conditions apply. Find out more@capital1.com venturexbusiness.
There is so much hype about AI now. What really bothers me is when I see all these people giving quote unquote master classes in AI when they have no experience in AI, no experience in technology. They've never mentioned the word AI before in their lives. Then there's another group of people saying AI is going to destroy the world. It's going to take jobs, it's going to do this, it's going to do that. I've been working in AI. I was an undergrad. I worked on AI. I went to grad school for AI. I had AI related jobs for many years, including in the investing business. But you've all heard from me. I wanted to bring on a friend of mine who is a pioneer in the space of AI. You might have heard of a speech recognition product called Siri. He helped develop that. He helped develop many other AI projects. He has a set of AI companies right now. Here's Kevin Serais and and we Talk a little bit about the death of cities. People always want to talk to me about that. And I understand because I've written about that. And then we get into the heart of the matter. What is the truth and what is the hype on AI and how can you use it to make your life better? This isn't your average business podcast and he's not your average host. This is the James Altiger Show. Yeah, we're going to talk about AI, but Kevin and I started talking about how cities are doing. I don't think it's necessarily bad for the country when cities are damaged permanently like New York City, San Francisco, Chicago and so on, because the talent disperses throughout the rest of the country.
Right. That is indeed what's happening and so is working out. But if I were in commercial real estate and hanging on to something at a certain value, probably that's not the value going forward, that value may be cut in half.
No, look, look at San Francisco, the big real estate developers and private, they're just handing over the keys to the bank. They're saying, look, I know we're good guys. Like you take over the building. Here are the keys.
Did you see that with the, with the big mall in San Francisco where everybody walked out basically and said, you know, it's a mall developer Simon Malls. And Simon. I think it's Simon, isn't it? And they handed over the keys. Yeah, handed over the keys to the bank. Said, we don't want anything to do with it. You can just have it. That's kind of crazy.
I know. It's astonishing. Like they pour hundreds of millions of dollars into this mall and like, didn't work out by. It cost us more to keep going then to just shut it down.
So it's the bank.
Like, the bank can't sell it. If this mall owner got rid of who's going to buy it?
You know what? Banks don't like to be in the real estate business, as we learned back when we had the real estate crash. Right. And everything falls on banks. The first thing they want to do is get rid of it at any cost. They do not want to carry that on their books.
Yeah. So maybe there's a bargain. But even if the bargain hunter buys it, what does he do? Turn it into an ice skating rink? Like, it's not going to make any money.
San Francisco has a retail problem because people don't want to go to the shop because of the homeless situation and a variety of other things. Right. During the day, the offices are half populated so that cuts that in half. And at night, nobody wants to go there. On the weekends, they don't want to go there. It's a, it's a real problem. Right?
Yeah. I mean, look, it's like New York City though. Like the good thing about San Francisco is the residential areas kind of are, you know, around. The downtown are fine, just like New York City. You go to the outlying boroughs, it's fine. But the, the bulk of the money, like let's say midtown and Wall street in New York City is dead. So how does this long term affect the future of the city? I think we don't really know, but there's going to be a significant problems.
It's significant problem. Are you, so you moved to Florida in the.
I was in Florida for a while. Now I'm outside of Atlanta. Georgia. Well, what about you? Are you still in San Francisco?
Right now I'm in upstate New York. We still have a place in California as well. But summer and fall, this is a stunning place to be.
Why not go to a place warmer like, like, you know, Florida?
Because we have a place in Maui for the winter. So I don't need Florida.
Okay, well, there you go.
With all due respect to Florida and its politics, we, you know. No, Maui. Maui is pretty good.
All right, good for you. So look, Kevin, you know, you and I, we've spoken about AI years ago, long before the current. I don't want to say it's hype because it's very real, the innovations in, in large language models, but what's hype? And I, I'm. We haven't spoken since about AI, what type? And I'm curious if you agree is every. I can't stand it. All these people who are. The last they were doing was marketing, whatever it is that they're marketing now. They're like, hey, join our masterclass, mastermind, you know, six day retreat to learn how to make a million dollars in a week on using AI. Like, you know how I made seven figures in three days using AI? I can't stand it. Like I've been working on AI related stuff since literally 1987. And I know you're probably been longer than that.
Since the 90s. Since, since the 90s. Yeah, that's right.
So. And I'm an investor in your, in your AI startup advance. So, so what's going on?
That's right.
What's, what's your take?
So look here, here's my take first of all, for the general public out there, right? We've been working on NAI since the 50s, as you know, this is, this is not new. There's been nuclear winters of, of, of, of, of AI death. But the fact of the matter is every step towards large language models happened because of prior steps. Right? Every single one. Like we, we, we understood neural nets decades ago, but we couldn't do deep neural nets until about 11 or 12 years ago because we just didn't have the compute horsepower and the cloud power and everything else.
Just to put that in perspective, even the large language model of OpenAI ChatGPT as we know it now, it took a year and a half of basically supercomputers crunching the data with neural networks before we had a first draft, and then another year and a half of supervised learning with humans, you know, going back and forth with it. So it was, but it was a year and a half of computational power with the latest supercomputers that got done what we needed to get done, which is longer than it takes for a computer vision model and so on.
Absolutely. I mean, I mean, only someone who had a billion dollars of Azure time and a billion dollar investment for Microsoft could have pulled that off. So like, it's not like some startup could just go and say, hey, I'm going to build a large language model that has a trillion tokens. It's not going to happen. Right. And so they had a unique situation where Microsoft said, we will give you free use of Azure, you can use anything you want and I'll give you a billion dollars. Go for it. And that allowed them in a very unusual startup way, to say, I'll just spend all the money. And, and hopefully when you, when you have a tri trillion tokens, you're going to get something interesting. Now, now that's a huge neural net, as you know. And then it turns out you get this huge neural net and it spews out a fair bit of garbage because of course it, it was unsupervised. Unsupervised doesn't mean a human was watching it. As you know, I'm telling this for, for your listeners. Unsupervised means that it, all the information isn't tagged, say whether it's real or fiction or true, whatever. So it's reading fiction, it's reading fact, and it's reading garbage too. It reads everything. Right. And of course it doesn't know necessarily that what it just read was fiction, a novel. And so at first, if you don't put guardrails around it and you say, you know, do you love me? Of course it's going to build a sentence that says, of course I love you, I'm madly in love with you. And you go, it's sentient. No, it happened to read 100,000 fiction novels. Of course it knows how to say I love you. Right? Has no sentience whatsoever. And so then, as you know, OpenAI for more than a year, hired a thousand people in Turkey, if I remember, and. And to start building a rules engine around it. Now what's funny is before we had deep learning at all, we built the entire AI infrastructure on a variety of rules engines. That's all we had, right? So we didn't have the. The learning, so we just said, I'll just build rules engines. And so when I was building the very first kind of versions of Siri for General magic in the 90s, and that's what Siri was based on, is all that work that we did, it was, it was hidden Markov models for speech recognition. And then it was all these big, huge rule models basically, that said if you asked, her name was Mary. If you asked Mary, do you love me? We would have all these randomized responses that were put together. But it was a rules engine that was doing that. And, and of course people heard that and they said, it's AI. Well, that's the compute horsepower we have.
So. And Kevin, just on that, I didn't know you worked on at General Magic on Siri, because I worked for a while with Kai Fu Lee, who developed the whole hidden markup models to recognize what your voice was saying. So it would use this very sophisticated statistics to recognize his basic project was funded by the Department of Navy. So the first example of hidden Markov models recognizing speech was fire the missiles and things like that. Clean the deck. And then he was over at Apple while you were at General Magic, presumably. And that's right. Just a point of trivia. I was in Norway a few weeks ago and I met this former weather girl, weather woman named Ciri, who apparently was Siri was named after her because the guy, I guess at General Magic or Apple or whatever, who was the product leader, hypothetically, I will say this is my words, had a crush on her and called her. And potentially, you know, she said, let him answer this question for sure. But potentially named Siri after this woman.
Before series, there was Mary, and Mary is named after Mary McDonald. And Mary was our voice artist for Barry. And that was, by the way, that became GM OnStar. That's what we built. Right? And so we had millions and millions of users on this system that were all using speech recognition. And she could read your email and get your calendar and answer your phone for you, which is really cool. She'd answer the phone and say, oh, hi, Kevin, I recognize the number. What would you like to do? I'd like to get on so and so's calendar. No problem. Put you on James's calendar. When are you available? Like, all of that existed in the 90s. Right. But even with those hidden Markov models, what we would do is we hired, we were the first to ever do this, a whole bunch of linguists that would literally listen to what you said and codify other ways to recognize it. So I'm going to give you an example. We recognize that if you said, read my email, we knew what to do. Read your email. I'll get you the first one. But some people would then say, get me my email. I want my mail. Where is my mail? And you go, there's a lot of ways to ask for getting your email. And so you had to codify those through linguists. And, and in fact, when then Siri started, which was based on all the work we did at General Magic, and then that got sold to Apple, Apple did the same thing. They hired a whole team of linguists and started listening and started coding. And then you could opt out of being listened to if you look far enough. But that's how you had to do it. Well, now we can self learn. At that time, we couldn't self learn. Now we can have these models self learn and get better by themselves, which is really, really cool. And that's what deep learning did for us. Right? That's what these neural, Deep neural nets did for us.
Yeah. And I just want to specify what that means with self learn. That it doesn't recognize that get me my mail means get me my mail. It just knows that the phrase get me my mail or I want my mail or where's my mail? These all belong to the same category. It separates that out From get me McDonald's, get me. It's. It says to itself, oh, all these statements are still in the get me category. But in one case, there's a. They're in two different contexts. It doesn't know what mail is. It doesn't know what McDonald's is. It's the supervised learning later that kind of teaches what actions you should take based on, on these different categories.
Right, that's right. That's right. So, so, so look, getting back to GPT. Look, GPT is overhyped in a way, like all new technologies are Only because it's the first time the public got to play with AI. Now, you and I being in tech, we've had our various brushes with all kinds of AI over decades, and it makes some progress and you use it, it just becomes part of your, part of your work. Well, all of a sudden, the public got to type something in and it talked back to you and you go, oh, my goodness. Now, if you remember, in the 60s, you know, we had a system from, from MIT. It was Eliza and Eliza. You type to it and it, and it actually come back. And it was a huge rules engine, but it was really pretty darn good. It was the first instantiation of sort of a chatbot that you could talk.
And I just want to say that the professor that came up with that. So Eliza was like an AI therapist, but it was very rules based. Like, if the word contains the, if the sentence contains the word mother, write back, tell me more about your mother. And I think it's Joseph Weissenbaum might have been the professor, if I remember correctly. And when he was, when his, he was out of the office, his secretary was playing with Eliza. He walks back in and the secretary says, can you stay out for a few more minutes? This is getting private.
No, really, really fascinating. And so, you know, again, most of the public doesn't realize this kind of chatting with an artificial human started all the way back in the 60s as an experiment. And we've been getting a little better every year and a little better every year. And then, you know, and then we had products from Amazon, we had products from Google, we had products from Microsoft, right? And they've all been getting better. And now this has gotten to the point where it is almost indistinguishable from a human. Almost. Right. You might be able to tell, but only because you can go to the system and it'll kind of give it away. But generally speaking, if you didn't know, you'd say, this is very human like, and it's so human like, because instead of learning. And you know, this so not, you know, but instead of learning words like we used to do before Transformer, it learns phrases. And because it learns phrases, it just sounds a lot more human. And it could put together phrases that mean something rather than put together a bunch of words. That's just a bunch of junk, right? And by the way, that hats off to Google in 2017, who figured out if I want to do translations to French from English, I can't just keep translating word by word, because in France, that didn't mean anything. I mean, you could figure it out, but the sentence structure was all wrong. Yeah. Then they said, why don't we just learn a whole sentence? And then you learn a whole sentence, and then you could formulate sentences out of what you said in English rather than formulate word by word by word. And that was the beginning of the entire transformer revolution, which again, took us another step better. And now we've got ChatGPT. Is everybody overhyping it? Yes. But will it impact most everything we do? Sure. The way Excel does. I mean, we don't think of Excel as anything more than an interesting tool today, but it changed everything we ever did in finance, period. All of us. Right. Changed.
And it didn't replace the entire accounting industry. In fact, there's more accountants than ever. It didn't replace anything. In fact, because it made us so much more efficient as a business, we were able to build bigger businesses faster, hire more people, and the economy developed, not all because of Excel, but, you know, Excel had its effect, just like many other productivity enhancements.
This is the point. That's the point. And the point here is people go, oh, my job. I've never seen anything do this. Stop. Just stop. Since the invention of the wheel, all of these inventions improve human productivity. And when you improve human productivity, you. You get more dollars of output per hour, which the US has been the best at probably in the world. More dollars of output per hour per person. When you do that, the companies get bigger. And I know someone's going to say, oh, only the people at the top make the money, et cetera, but just trust me, the companies get bigger, the GDP gets bigger, you end up having more money to spend on vacations or products or consumer goods or whatever. And round the world goes in a very positive way. The only way today you're going to double the size of your company because you can't hire double the number of people. There are no more people to hire. We're 10 million behind. Right. The only way you're going to do it is get twice as productive as you were three years ago, and AI is going to help you be twice as productive in marketing. I can now write a blog post in 10. Now I'm going to probably spend a half an hour editing it, but it used to take me hours to write it, and now I can probably write it in one minute and spend a half an hour editing and I'm done. So I may be 80% more efficient in writing a blog post than I've ever been in my Life.
Being an Entrepreneur is a 24, 7 job. And when you're hiring, you need a partner that works as hard as you do. That hiring partner is LinkedIn Jobs. When you clock out, LinkedIn clocks in. LinkedIn makes it easy to post your job for free. Share with your network. Get qualified candidates that you can manage all in one place. For one thing, there you could post a job. LinkedIn's new feature can help you write job descriptions and then quickly get your job in front of the right people. You get qualified candidates. At the end of the day, the most important thing to your business is the quality of the candidates. And with LinkedIn, of course, you can feel confident that you're getting the best. Based on LinkedIn data, 72% of small medium businesses say using LinkedIn helps them find high quality candidates. Find out why more than 2.5 million small businesses use LinkedIn for hiring today. Find your next great hire on LinkedIn. Post your job for free at LinkedIn.com altiture that's LinkedIn.com altucher to post your job for free. Terms and conditions apply. You know, I was talking to Matt Barry who's the CEO of Freelancer.com they have 60 million freelancers on their platform. He said a, the number of freelancers is shooting up, which is why kind of the unemployment data is so skewed. But it's great. Like, let's say you're a logo designer now. Instead of doing one logo a week, you could do 10 logos a day because of midjourney. But that's right, the companies still need someone with a design aesthetic. You still need a human to kind of manage the product. You're not going to just be the CEO of company and, and, and you know, design your logo because you still don't know if it's good or bad. Like you still need to hire the logo designer.
I think you're right on. Is that what we're going to find is that we are going to, we're going to make a few logos or a few graphics ourselves and then we're going to go, I'm not actually graphic person. Now we did democratize access to tools that allow you to, to generate graphics that you never generated before or to generate music or to generate video. Right. All these things. This is amazing. But in the end you're going to hand it to a professional. But instead of them taking three weeks, they're going to take an hour and they're going to do it at a quarter of the cost and they're going to give you 10 things to look at that they think are really, really well designed. You're going to pick one and you're going to be out of that loop in an hour or a day instead of what used to take weeks. And that's what I'm finding. I'm designing the next PowerPoint or Keynote or whatever. You know, I am getting all this material that I didn't have that used to take weeks to generate that can be generated in minutes or hours.
What I tell people is exactly this. That. Don't think of AI as the Terminator. Think of AI as your new assistant. And whatever you want to do, whether you're researching for a podcast like this one, or whether you're outlining a book, thinking of business ideas, AI can assist you with the right prompts, with the right questions. I don't think you're going to write the most successful novel in the world just using AI, because that needs human experience and going beyond the human frontier to write something no one's ever read before. Same thing with music, same thing with a lot of kinds of art or not. We'll see. But I also don't think people think, oh, well, this is AI now, wait till next year. I don't think we're going to see exponential improvements. They've already crunched the trillion tokens and everything written in all of history, and this is what they have.
So.
And it still required several years of human supervised learning. So it's not gonna be like, oh, it can write a bad novel now. So next year it's gonna write the most amazing novel in the world. It's just gonna have incremental improvements. The technology's out of the box now. Now is where we have this, like, computer vision that this has been a solved problem for at least 20 years, and it's not gotten that much better. It's still, you know, we're still doing the captchas where we identify these are bicycles and these are street signs.
And then you have to supervise it. Yeah, it's super. Now, our rec rates on images has now approached, you know, 98 to 99%. It's actually better than humans, right? For like a wolf versus or a fox versus a dog, for example. Right. A coyote versus a dog. Like, the AI is better than we are, necessarily. But what's interesting is past about 2015, it stopped getting better. We got to 98 to 99% in image rec, and that turns out to be better than humans are. And it just really didn't get any better than that. Because already we have unlimited depth of neural nets, unlimited training, and eventually just run out of stuff to train. Right? There's a. I have no more data, I have no more supervised information to train you on that doesn't start to corrupt the data. And this is another thing. I would say two things. One, AI makes these jumps. And. And you're absolutely right on GPT. GPT made a jump in large language models, and now there'll be a bunch of large language models that work faster or better. We're going to give you whatever and that jump's been made and now there'll be tiny, tiny, tiny little incremental improvements. But if you go from a trillion tokens to 10 trillion tokens, no, it's not going to get that much better. You. You've asymptoted all you can get out of that database.
I'm going to use that as an insult. You asymptoted your way out of that situation, you jerk. Like, yeah, well, I mean, that's all there is, right?
They kind of did this and leveled off. Nothing wrong with that. The other thing, I'm going to give you a term. I don't know if you like it or not, and I kind of stole it, but I. So I used to say augmented intelligence. What's AI? What's augmented intelligence? You've got this assistant. Actually, it's amplified intelligence because I can take my one brain power now and essentially be the equivalent of 10 or 100 brain powers, right? In almost any field, whether it's medical, whether it's writing a novel, whether it's writing a marketing affiliate, whether it's coding. All of a sudden I can code 10 times faster than I was ever able to code. Now I've still got to debug it and it's still got problems. And so it still needs me, but I'm the equivalent of many, many, many brain power now instead of one brain power. This is incredible, right? And everybody's going to have more than one brain power. Now that has an interesting outcome. It says that IQ overall will get somewhat depreciated because everyone can have 3, 5, 10, 20, 100 brain power and EQ and collaboration will become more important. And because if you've got all this brain power and you're going off in a direction but you didn't collaborate with anyone else, you could be down in the wrong direction, right? So collaboration between team members is going to be really, really appreciated. And iq, anyone can use these tools, right? Once you learn to use the tools, you've got The IQ of the tool, which is really high.
So I wonder. That's an interesting question. I wonder if per industry, it'll be possible to measure the difference between someone using AI as an assistant versus someone not using AI as an assistant. So here's an example. Like, let's say I'm gonna take a random one, like tennis. So let's say an AI assistant can watch you play tennis, see the arc of your serve, you know, when you swing, and study all your. Your health and your workout regime and your training and your opponent and your games. And it gives you suggestions on how to train, how to swing, what equipment to use, what to eat, how to play against an opponent, and so on. I wonder how much better the AI helped person will be than the non AI helped person, and if that could be done per industry, like writing, music, chess, business, and so on.
Well, that's a great question. So I think it depends on what you've got the AI doing. So in this case, we're asking the AI to be my tennis trainer as opposed to a professional trainer. Right. And then you get to who was the professional trainer and how much experience do they do and how good are they interacting with me and all of those other things.
But. But augment it with a human trainer as well.
Oh, we. It's got to be better. I mean, as long as it can be multimodal. That is, as long as I can give feedback. And it says, oh, I saw your stroke and it's this. It's a little bit like, can I evaluate ECGs better with AI than I can boot cardiologists? Well, of course I can. That was solved five years ago, like we know we can, because a cardiologist will miss things that are ever so nuanced that AI will see. And this is true with X ray readings. Right. I mean, you know, you can. The AI will see things that the human eye just won't pick up.
Yeah. In fact, they passed a law then that a human has to be the one to tell you the news.
Yes. Human has to be one to tell you the news, even though you're using these systems that know better. So then the human evaluates that human doctor says, okay, it's. Your radiologist says, well, okay, well, I'll agree with this, or I disagree with it or whatever. And the AI is right. Now, the problem with AI is a bunch of hidden layers. Right. So when you've got these neural nets, you've got a bunch of hidden layers and people get angry. Well, that's not explainable. Here's my explanation of why it's not explainable. Like, when I look at you, I can say, oh, I know you, curly hair, glasses, probably has the headphones on, has a microphone. I get it, right? Like I know that, right? I know how to recognize you, but AI will recognize you in a thousand different ways. And, and there isn't an English word for each of those methods. All those hidden level layers, they don't mean to hide it. It's just, there's no way to explain what that was. I saw a little thing here. A little thing. There's no explanation. So, so that's the, that, that's sort of the interesting thing is that you want AI to tell you exactly what it found. And it says, I can't, but after looking at a million X rays, I know this person has cancer. I have no way to tell you why I know that or even maybe where I see it. Right? It's just, this is a pattern I've recognized before. And the AI is unlikely to be wrong in those cases if it was well trained. Right.
Now let me play the devil's advocate a little bit because I've spoken to a lot of people and a lot of smart people, and I've almost been disturbed by how negative they are. And just as an example, I was in New York City the other day and I had dinner with a bunch of hardcore scientists. Like, these were professors, well known physicists, well known chemists, biologists, a Pulitzer Prize winning science writer and other science writers. And they were universally pessimistic about almost every technology, but particularly AI like, oh, you know, AI is going to basically turn the guns on the humans and decide to take over the world and all this other stuff. Hey, AI is going to make viruses that kill everybody. Like, okay, I get it, some people are, tend to be more negative than positive. But what are the negative aspects of like, okay, let's take another one. I had a conversation with Vernon Reed, who was the head of the band Living Color, had the song Cult of personality in the 80s, one of my favorite songs. And he was like, what are you going to do when an AI version of your father's voice calls you and says, you know, son, I'm stuck in the middle of nowhere. I need you to wire this money right away. You know, please help me. Like, is there going to be more? What kind of problems are going to result?
Sure, sure. Great, great, great question. A great conversation piece. So first of all, everything AI is doing today in terms of deep fakes, from voice to visual, has been available in Hollywood for 25 years, right? This is not like we know that Hollywood has been able to people or put people in movies that have been dead and all kinds of things and they're incredibly convincing and put people into, know, change their face and do all that, right? In fact create people out of nothing as Pixar has been doing for 25 years. And, and this is a really fascinating thing, all this technology is doing is democratizing access to those tools. So those tools, you know, used to render like one frame a minute and take six months to render, right? They were hugely, you know, painful to do. But the models for them were understood. They weren't the same as AI models are today. They were rules based. But nevertheless, Hollywood's had these tools. But we knew that Hollywood wouldn't, wouldn't use them to call you and try to get your money, right? We knew that, so we trusted that. So none of this is new. Deepfakes are not new. We could make Obama say anything we wanted to. Twenty years ago, however, it required Hollywood tools and millions of dollars, so nobody did it. Now we democratized access even to this. And by democratizing access, it means we can use it for free or a dollar or two. And so can bad guys, right? So, but this has been true with every tool in the world that has come forth forever, right? Bad guys use them. Bad guys use everything. There's bad guys who use Excel. I mean, it just is what it is, right? They use banks, they use the banking system. So here's another set of things, and it is true that already people are getting calls from their mom or their grandmother and it sounds exactly like them and to please wire the money and they think it's them, etc. Etc. So we're going to have to be more diligent on what we believe because you will no longer be be able to believe that watching that president in that park, exchanging money with that person actually happened. You have no way, in fact, you may have no way to tell whether it actually happened or not. And for all of history, we've always believed it happened unless Hollywood told us otherwise. Because they've, they've told us otherwise for decades. That's not new, right? But now this isn't Hollywood. It's just Joe Schmo down the street, some kid who generates it, right? So we're just going to have to be more thoughtful about what we believe and what we don't believe. And you will not be able to believe every video that you see. Let me say one other thing. People have been Photoshopping, you know, things together, at least in still frame, I don't know, for three decades. Right. So. So fakes, deep fakes on Photoshop have been around, but you needed to be a good Photoshop jockey to do it well enough to hide the fact that you put the face on someone else's body and, you know, and maybe you hid that with a necklace and, you know, all these tricks. Right. So that's been done in Photoshop for 30 years. But you needed to know Photoshop, which wasn't that, except for $100, you could learn Photoshop. Now people can do it by just typing text. Put this head on this body, and there it is, you go. Okay, well, now I put them in a place they weren't, change the background, put them in front of an oil plant, put them with money in their hand. I could do that with anything. Right. That's. So I've democratized access to it.
So I think this is the real problem. Like, this is the real negative thing, if you want to find something negative about AI, is that we're going to be dealt with a lot more. Let's call them, you know, scam. Yeah, Fake news, phishing attacks, scams. And it's going to be harder and harder to verify whether something's true. So verification is the key. If someone claiming to be your mother calls you and needs money desperately, you just got to verify somehow that this is a true thing.
Yeah. Call your mother back. Your actual mother on her actual phone.
This is.
This is not hard. It takes an extra minute.
Right.
And that's fine. You know, that is not a bad thing. The other thing is, throughout history, when technology comes forward, new technology, whatever it is, do you notice? And I love scientists. We need scientists. Know, it's usually scientists. Oh, it's the end of humanity. Oh, it's going to be all over. Okay, look, this is a language model that is doing for text and language what the calculator and Excel did for math. That's all. And we solved it in math decades ago. And now we're doing it for language, which is a much bigger problem. Do not hook the language model to the nuclear arsenal. Okay? This is a bad idea.
Right. And by the way, we've had the ability, because I was once offered a job to work on this at MIT Lincoln Labs. We've had the ability to recognize, using AI, which objects in space were junk and which objects in space were nuclear missiles heading towards us. We've had that tech for 30 years. So never then did we hook up the AI to make automatic decisions.
Hey, in fact, we signed a treaty with Russia back in the 80s to not use any form of AI to automatically launch weapons to give it to people who would then make the decision. There's actually a treaty against this, against using AI and hooking it up directly. Because we knew in the 80s, even with the AI we had then, which was very simple, that this was a bad thing. Right? This.
Right. So it's not like suddenly we're going to change our minds and say, you know what? I want to kick back and have donuts. I'm going to let AI make these decisions for me. It's not like magically we're going to give AI the power to do something they could have done 30 years ago.
Right? That's right. No, nobody's going to hook it to the nuclear arsenal. Nobody's going to hook it to crazy things. Everybody relax. It is not sentient. It is not dangerous. It's just a large language model, just like we have large math models. And by the way, a large language model is actually a large math model. It's only math. Yeah. I mean, in the end, all we're doing is we're assigning probabilities to neurons, right? To neural nets to say, well, the probability to put this word after that one is based on what they, you know, asked me is here. It's easy to, well, use, you know. Yeah. And that's all it's doing, is forming sentences. Everybody relax. Right? These scientists, God bless, are wrong. Now you got a lawn out there going, oh, open AI is going to kill everyone. Then he starts his own company. So I think that's a little disingenuous. I think it was all positioning.
No, I agree. Whenever, like one of these guys says something, even, even like Warren Buffett for his entire career, if he says, you know, there might be a chance terrorists could attack the super bowl with nuclear bombs, what does he do next? He's an insurance company. He sells insurance to every Super Bowl.
Yes, yes, he does.
So you always have to look at what the agenda of these, of these guys are and, you know, Godspeed. They're the most innovative people around in some cases. But, you know, Elon Musk certainly created a lot of innovation. But why do you think that Google engineer thought the AI he was working on was sentient? Presumably he's tech savvy. He knows everything any other tech person knows. Why would he think that it was suddenly sentient?
I could only guess, and someone's going to hang me before I can Only guess that it was kind of his, subconsciously his time to get in the limelight. And today you're not in the limelight. If you're going, listen, it's just a freaking math model. Everyone calm down. It's. Oh, it's going to kill us. Put you on every podcast, Right? So I'm here clearly stating, because I understand the underlying math and so do you. It's freaking math. Everyone calm down. Don't hook it to the nuclear arsenal. We're fine. But if you're him and you're one of lots and lots of important people at DeepMind and Google AI and everything else, you know, you're not getting any press by saying, this is really cool. In fact, you're not getting anything. So it's better for you to leave and say, I have interacted with this thing and I think it's actually sentient. Okay, well, now you get all the press in the world and now you're really, really important. Right? But it's just bs. It's just math. If you understand the math, it can't be sentient. It does not know what it's saying. It learned from trillions of phrases and it put them back together for you in some random way, but, you know, thoughtful way, from novels and from truth and from fiction and from everything else, with a huge rules engine around it again, that took a year and a half to put together. Everyone calm down.
Right? It's sort of like a simple way to think about. It is the, the Google search box. If you type in the letters S a N and you live in San Francisco, Google is smart enough to know that Francisco is probably the next word you were going to type. It's just using the same statistics, but like you said, it went from words to phrases. You've got a much more sophisticated and larger model now. What about cyber security? Like, what's, you know, obviously AI is now going to be used by the bad guys to figure out where there might be holes in operating systems and so on that they can exploit.
So here's the interesting thing. Since the, since the advent of ransomware, everything in cybersecurity has changed. So it used to be bad guys got into your network and messed it up, but because they hated you or because they could, or because then ransomware came around and it was like, I can charge $100,000 to not reveal their data on the web or just not steal whatever to give them back their data or give them access to whatever, okay? Then we started encrypting our data and that meant that people getting into our network, maybe they could do some network damage, but they couldn't do anything with the data because all the databases have become encrypted except our applications. All of them know how to decrypt the data. So now you want access to the applications because then that's how you get the data. So then they go, well, I'd have to come in the front door. Well, it turns out that's freaking easy because passwords and IDs are dumb. People use their kids names and 1, 2, 3, 4. And use the word password is the most common password. Right? So what happened is there's an entire network now of identity access brokers. And what they do is if you're a ransomware person, you go to an identity access broker and say, I want access to someone at bank of America. I'm making up some, some teller, someone who has access to accounts or whatever you want to do. Right. That comes in through the front door and they go and get you that access, including MFA. So all traditional MFA has been hacked. What's 100%? Oh, multi factor authentication. So the codes that come on your phone.
Yeah.
Ridiculously easy to hack. They're easy. And I can, I can show you the social hacks right now. I won't tell everyone how we do it technically, but technically is harder. But actually pretty easy, like in minutes because I have your cell phone. I can certainly get all your codes this afternoon. That wouldn't be hard. Okay. But the easiest way to get MFA is actually simply a social hack. And social engineering is very easy. So let's say you're at a company, but you're at a big company, not a small company. Okay? And the big company, you're one of 50,000 employees. It calls you, says, hi, this is it. This is Jim from IT or Bill from it. James. We've, you know, we've. We think we've got to break into your account. What I'm going to do is I'm going to initiate a login and, and password that's going to send you a code. I don't have access to that code. So I need you to share your code once, by the way, just to validate it. Your employee number is this. Your Social Security number is this. You go, oh, okay. You're on the phone with them, right. You get your code. You say it's 1234, whatever it is. Right. They then put that in. They now have access to your account. They say, you know what, we're in. We're in Together, looks like everything's fine. Thank you very much. Goodbye. You hang up. They now have access to that data. They're sucking out data. Takes them 20 minutes. They've got everything they want. You handed them the multi factor authentication from your phone or from RSA card or whatever it was, and now they're going to hold the company ransom. I know in one case, $22 million recently in Silicon Valley.
Oh, my God.
Did they pay?
Did that company pay?
Oh, yeah. Oh, yes. What was absolutely.
What was the data, roughly? You don't have to say exactly.
It had to do with running machines. And what they did is they essentially went in and changed all the data and they didn't have a backup for several weeks and they wouldn't be able to operate the machines. That basically shut them down. And so it was cheaper to pay the 22 million and bring the place back up. Wow. I have, I have example after example of every. By the way, everybody pays and almost no one knows. They don't publicize it. Right. They try to just bury it. This is true with universities, it's true with hospitals. We've, you know, every hospital pays. They cannot let that patient information out. Yeah, you know, that's it. So, so then you say, I got to close the front door. So one of my companies that you're not an investor in, but it's a, it's a great company. It's called Token Ring. Token Ring is literally. I don't have one on, but it looks like this. It's a ring that you put on your finger, and when you put it on, it's tied to your fingerprint. So you've registered your applications with this ring. Okay. That ring now only works on your finger. No one else's finger. They could steal it, you can lose it, it doesn't matter. Right. And your bio information is stored inside the ring in a secure element. So if you try to get in there, it destroys the information.
You know, in the movies they're going to just cut off your finger and use it.
Well, yes, in the movies, but it turns out we're not trying to solve for people cutting off your arm, that's a different problem. Right? That's a, that's a different level of crime. As you know, most of this ransomware happens from people far, far away in Russia, in China and in North Korea. So this is fascinating because now your access is tied to that ring and it goes behind your application server to something called a FIDO2 server to validate that you are you. And 128 bit encryption happens in one second. So we can, we can't decode that today in that speed. And it's different for every application, that validation. So it makes your access 100% foolproof. And no one can call you and say, give me your number. You go, I don't have a number. What are you talking about? I have a ring. There's, there's no information on the ring, there's no serial number. I can't give you anything. And they hang up, right? They go, well, you're not helpful. I can't do anything right. So, so the solution is to close the front door. The solution is with I think wearable biometrics. And anyway, so that's one of the other companies I have because I, I think cybersecurity has to be solved. And in this case, I can't beat it. Either there's nothing AI can do, like, because, because they can fish you all you want, but they can't get your ring, doesn't matter, or they can't get the ring and get access. You know, phishing's all about, hey, I'm, this is easy, I'm going to steal your password and your login id, but if they can't steal your password and if they can steal even your password, login id, but they don't have the ring, they still can't get in.
Will quantum decryption eventually be there for decrypting or are we decades away from that?
So, as you know, quantum computers are coming along and we're looking at things that are getting into the hundreds and then thousands of qubits now. So this is really fascinating. However, we're talking about two or three quantum computers in the entire world that, you know, live at Google and IBM, right? So like, there's no one has access to these things right now. So I think we're at least a decade away from bad guys having maybe two decades away from bad guys having access to a billion dollar quantum computer, right? This, this access is highly limited and it's for researchers right now. And these things are only doing sort of one thing. A quantum computer could certainly decrypt 128 bit encryption. If you could do a man in the middle attack, it could decrypt it in a second or less. However, you've already completed your transaction and it's gone. And the next time that you know, those encryption keys will be different. So it still may not solve it because that rotates around. It's not as simple as I've decrypted it and now I've got it. Right. By the time you've decrypted it, the, the, you know, they're already logged on and they're doing their thing and there's nothing you can do. Right. It's, it's a little bit late. So I think it'll still be hard. I think it'll be two decades before bad people have quantum computers. And by then we may do, you know, 512 bit, 1024 bit encryption.
Yeah. There are algorithms also for when there is quantum encryption or decryption, but I just don't know how far advanced those algorithms are and I don't know how fast we can employ them.
The problem is the speed of the processors. Right. So think about the processor I have inside a ring that I have to do decryption on. So I can do 128 bit encrypt decrypt, but if I had to do some quantum encrypt decrypt, that's just a massive amount of processing power that I might not have in a bio ring. Right. Which has a tiny little processor in it. So that's the problem. But you know, that's a, that's a problem 20 years from now. Again, no one has access to these things but researchers at IBM and Google. So you can't log on and say, I'm using a quantum computer as a bad guy. In Russia, you don't have one and Russia's not going to develop one. Right. They, yeah, they lost whatever, you know, brain power they had. So.
And I guess the, you know, the other thing that's very interesting in the AI space is how many AI companies have started overnight? Like there's like hundreds of thousands of AI companies have started in the past few months. And my own gut feeling is when I look at these companies is that there's nothing special. Like it's so easy now to just hook up to the API of ChatGPT and make a pseudo company that anyone else could also create overnight. So on the one hand, the price of making an AI company has gone to zero, but on the other hand, none of these things are worth anything because they're not really doing anything of value.
That's right. Where's the moat? Right? Do you remember when mobile, once the iPhone came out and then there had to be a hundred thousand mobile first companies. I'm doing mobile, I'm doing. And there were, I don't know, easily a million app companies that were writing apps for iPhone. Right. Are there like 20 that ever made Money, some number like that. It's amazing, right? It's a very, very small number of apps that ever made any money. Yet all of these companies got VC funding, tens of thousands of companies got VC funding to do some app for the iPhone of which nobody made any money. In fact, all the downloads are Facebook, Twitter, you know, you can just go down, you know what they are, right? There's 10 downloads that everybody has and then usage on their phone goes, goes pretty low. So most of those app companies didn't get anywhere. And that's going to be true with AI, right? There's the rush to everybody's going to do AI, but, but if you can write an AI interface in a weekend, your moat is too small. Now, there's other companies, you know, App Ants is an example. It's taken years of AI effort to get to where we are. Yes. We're also leveraging large language models in unique ways. But even that is another year of effort to, to, to make that work across, you know, the plethora of mobile and web applications. It's not something you do in a weekend and hook up in a weekend and go, I'm in the test business now. There's a few startups that have said, oh, that's what we're doing. Good luck. Where do you have to test every application with every library, with every different set of code that someone has created? Turns out it's very hard. It's really, really hard. And you've got to use visual information, it's got to be multimodal and, and then people give up. And I've seen this happen. People start and a month later they're gone. And yeah, you know, two months later and they, they go, this is really freaking hard. I thought it'd. So I think the easy ones, you're right. And they probably shouldn't get funded and there's a rush to fund them and the hard things will be hard and some of those are going to succeed.
Yeah. And again, I think just to wrap this up, just as a mindset, view AI for every possible problem where you get scared, oh, AI is going to replace me. This is going to happen, this bad thing. Think of AI as an assistant instead. AI will be a very good assistant and will make your life better. And it's not that hard to figure out and start using. You could do it today. You could just go to, you know, whatever. Let's just say you go to OpenAI.com chat.OpenAI.com Sign up for free and start using it and you'll see you can use it as an assistant for most of your jobs.
Copilot that's now been out two years from Microsoft, by the way, it's in GitHub. Right? Two years we've had Copilot that helps you code. And it's getting better and better. It's based on GPT4. Now that is making coders latest stats 55% more productive. 55% more productive. You can't use it without a coder. Like it would be ridiculous because it's just giving you snippets of code and hints of code and, and it doesn't always work. And you have to, and then you have to modify it to make it work for exactly what you're doing, etc. But that means I don't have to write every line. It'll. It'll spit out 20 or 30 or 40 lines of code just from my typing, just like Word does. You know how you start to type and it starts to finish the sentence? Yeah, that is exactly what Copilot for coding is doing. It literally finishes your code. It's not exactly right all the time. Sometimes it doesn't compile. But it's better than what I used to do, which is go to GitHub or go to a variety of open source places and start to look for open source examples. Because you'd want to start with an open source example often today for this function. Now it's just giving you that example. This is. It's a 55%. That means in theory, we might be able to double the productivity of coders using this. And so it should be a given in every coding shop that of course you're using Copilot.
Do you still code?
Not as well as I. You know. You know, here's the problem, right? As you move up in management and you move into architecture and things like that, you lose the ability to do it syntactically correctly. Right. So I could still sit there and write pseudocode and people go, okay, I know what you mean, let me go fix it. But, but to sit there and do it, you have to know the syntax and you have to remember the syntax. Exactly. Exactly where does that bracket go? And exactly where the comma goes? And so if you don't do that all the time, you lose that.
Do you think age has something to do with it? Like, the last time I tried to code was about two years ago, and I just was really unbelievably, strikingly bad at it. And I used to, you know, I've put in my 10,000 hours on coding.
And I did, too.
I just can't. I really just can't do it anymore.
I don't know if it's a great question whether age has to do with it, or we simply just graduate to higher level thinking. Right. And you get to, again, architecture and systems level and thinking about where the world, you know, and then you just. That's just not a skill. Okay, could you do long division? You might not be really good at it, but if you struggled with it for a while, you could do long division. But you haven't done it since, I don't know, fifth grade maybe. Right. Nor have I, but we were taught it. But we've kind of forgotten how to do some of that because the calculator came about. So. I don't know, I think if you said, I am going to learn Python and I'm going to take a month to learn it, or two months, at the end of two months, you'd be every bit as good as you ever were. And you might be more thoughtful about it, you'd probably be really fast, but you might not enjoy it. You might say, this is. This is dumb because I could beat a whole other level. So I. Look, I think copilot is a miracle for coders. It's fascinating, but. No, I wish. I wish I coded as fast as I did when I was at IBM and I could just rip code out thousands of lines, you know.
Yeah.
But those, those days are behind me and you know, you got to give up something, right? You just can't do everything all the time.
I guess so. Yeah. Sometimes I try to do everything all the time, but it's. It doesn't work, but doesn't work. Kevin Serrays, you know, thank you so much. There's been so many questions and angst and anxiety and curiosities about AI just from everywhere. And I've had my own frustrations. Just see how people have been abusing the words AI and what they do. But look, they're trying to make a living too, so I don't blame them. But thanks so much for helping clearing the air on all this stuff and good luck with all your entrepreneurial efforts, particularly the ones I'm invested in, so.
Yes, exactly. Exactly. Well, we'll keep plowing along and we'll get back together maybe in six months and see where AI is then. But I think. I think all this hype is going to settle out and it's going to settle into, like I said, what Excel is today. It's a great assistant. It's a great tool for us. It doesn't run itself, nor will AI. You have to prompt it. You have to get stuff back. You have to edit it. You have to be thoughtful about it. But what a powerful tool, and what a great time to live. Like, I can't imagine living in another time. I'm sure our parents thought, oh, there's color tv. Look at that. Okay, this is way better than color tv, right?
No. And, you know, because of the increase in the speed of computers, and it's created exponentially growing industries in many other industries that required the computational power. So initially, computer technology was the only industry exponentially growing, but now that it's exponentially grown, it's unlocked the power for other industries to exponentially grow. So that's what makes this super exciting time now. So I agree.
It's amazing. It's best time to live.
Yeah. So thank you so much, Kevin, and I'll talk to you soon.
Yeah. A pleasure.
More from Kevin
Present Model for Sustainable Investing is Deeply Flawed with Robert Rubinstein #8
Chairman and Chief Technology Officer of Appvance.ai, Kevin Surace on The Shades of Entrepreneurship
AI Sales Revolution: Transforming Revenue Engines and Empowering Sellers with Kevin Surace