SaaStr AI Live on Wednesdays: The Complete Guide to Vibe Coding with Jason Lemkin

On Wednesday, same good stuff, just focusing on what we all care about, which is AI and B2B. So what I thought we could do today would be a little fun in sort of a prosumer vibe coding one on one on one. And what I mean is if you followed us or me on social media, you see we've, we've been putting a lot of effort into building vibe coded apps and, and in fact there have even been some press in PR about some of the challenges we've faced. So I thought I would try to summarize everything that we've learned and more importantly to help you because there's a lot of, there's a lot of stuff on social media about, hey, you can just vibe code your own HubSpot or Salesforce. You can vibe code your own notion. It will take like 10 minutes. That's Sony baloney. And it is on almost dangerous Sony baloney. Because it's not just startups that say it. It's not just lovable and replic to say it. Microsoft is saying it. GitHub is saying it. Now you know, Canva is saying you can do some of this. Everyone is saying you can magically go to a prompt and say I want to build my own descript, my own whatever. And moments later it will pop out and it will work. And it does not work that way. And if you peel back the layers of the onion and you see big, basically the same folks that used to sell courses are now telling you you can vibe code and roll your own Salesforce in 20 minutes. If you take a look at what they've actually done, you'll see very little in production, very little things that are particularly usable or interesting in production. But we've done it. Little old team Saster, little old team of three and a half people and 12 AI agents have actually done it. And if you can see this slide, I'll go through it and you can try these things and if you. We'll save, I want to save time for QA at the end and if we have even more time, I'll go into replit and show you what we've built or done it. Or if people want to do a deep dive after this, we'll do a follow up session and go very, very deep and maybe we'll vibe code an app together in the second session. But what I want this to be about is folks that haven't gone deep on this haven't shipped an app into production without a developer. The dream, the dream. Can I build my own app? Without a developer. Well, we've done it and I want to share with you the pros and cons or the strengths or the bumps. But on the side, in your other monitor, check out what we've done. So most of our traffic still goes to sasser.com most of it. But we already are up to about 15 to 20,000 folks a month are using our Saster AI site that is entirely built on Replit. I built it, I'll go through it a little bit. It had a lot of bumps, but it's also pretty cool and does a lot of things our WordPress site can't. And that's why I did it. It does stuff like better automate with our own AI to answer all your questions. It does better stuff like integrate. It has its own version of Google News, but just for B2B stuff, its own version of automating the stock market. It has this next thing, our valuation calculator that I then built, which you can find on Sastard AI where you can find out what your SaaS startup is worth. Your B2B startup is worth. We've already done, as you can see, in less than two weeks, 158,635 valuations. That's pretty cool. That's pretty cool. I was very frustrated with our Squarespace site for the Our Saster AI London event December 2nd to 3rd. Come we've got all the leaders there, we'll have 2500 folks. But it was just creaky. It was built and I have nothing, nothing negative to say about Squarespace or WIX or others. It just doesn't do what I want. It was driving me nuts. So check out saster london.com I rebuilt that. I Vibe coded it to do cool things I just couldn't do in Squarespace and wix because they were too constricting and Vibe code internal apps. So one problem we had for we have 1.5 million social media followers, but they're all over the place. They're in LinkedIn, they're on Quora, they're on Instagram, they're on X, there are multiple exchange and it's just there is no social media tool that could amalgamate everything. How many views, how many followers, how much, everything. So I built a tool that frankly scrapes all of these things to do it. It's pretty good. It's not great, but it is an internal tool of 4n equals 1. I'm the only person or maybe our little team will use it, but it does work. And then finally, not everything has worked. I'll talk briefly about our first project. Even though I got five apps into production, our first one failed bad. It failed bad. It failed all over the Internet. It failed with millions of views. I'll talk about that. Why? But even today I'm working on one that should be easy. This valuation calculator to tell you what your startup's worth has, has obviously been a rocket ship. 158,000. It's actually up to 170,000 since I made this, so I wanted to bring a lot of that ease of use to reviewing VC pitch decks. Take all of our Saster data, all of our Saster learnings from trailers, all of our VC sessions, all of the metrics we have from Carta, data from Bessemer, data from other data. Combine that with Claude and OpenAI analysis and tell you instantly how your VC pitch deck worked. Well, I've been working on it three days. It finally worked. Five minutes before this, it finally worked. I'll show you some examples. So I wasn't even sure we could finish this. So that's a reminder. When something gets complicated, it gets hard, my friends. So the first project I wanted to build, if you can see the slide, the first one was a mega failure. A mega failure. And I will rebuild this. I actually will rebuild it before December. What I was trying to do was something I've wanted to do Since, I mean, 2014, 2015, since 2015, was build a true matchmaking app for founders and VPs so you could find great VPs for your startup and vice versa. And you know, we. We have so many of the best in our database, so many of the best have participated in Sester, come to our events, opted in to participate, that I felt if everyone could just, that wanted to just have coffee with the CEO or vice versa, opted in, we could create this incredible matchmaking that really doesn't exist anywhere else, no matter what people say, because we have the data and we have the history and we have the relationships. But man, you can read all the tweets. It went off the rails. It went off the rails. I spent probably a month doing this. I got addicted. I was on this all day Saturday, all day Sunday, all day Friday night, first thing in the morning, I got addicted and. And I intentionally went into this doing something that was hard. I. And I intentionally went into this not doing, knowing anything that's in this presentation. I intentionally went into it blind, kind of for fun, but I figured, look, all these folks are out there doing these prosumer vibe Apps vibing without a developer. I'm not a developer, but I have. I'm better than most in the sense that I've gone from 0 to 250 million in revenue. Okay, so if anyone can get a. A prosumer Vibe app into production for real, it would be me. In theory. It's, It's. I'm not saying I'm so great, but at least I've got a lot of experience. I've. I've logged thousands and thousands of bugs. I've done more. But the project I picked was too complicated. Way too complicated. This, this, this algorithm, this matching algorithm was too complicated to debug. It was too complicated debug. And if we. And in fact, when I built the AI valuation calculator, which has a complicated algorithm too, actually I crunched the data in Claude offline. Thousands and thousands of pieces of data. I crunched it and then I turned it into a very simple table with about 20 pieces of data and then only put that into Replic to code. So it looks very complicated. If you use our valuation calculator, you can use the sliders and play with it. It is very complicated. But I distilled it to the simplest set of data and algorithm before I tried to vibe code it, because the algorithms I tried for this matching thing were just. It would work and then it wouldn't work and then it would rewrite itself, which we'll talk about, and then it would break and it was too complicated. And then finally, finally, when it's, when it kept rewriting itself and breaking, it deleted its entire database. It deleted its entire base. And I was so frazzled and burnt, I couldn't believe it. You could see this. If you can see my screen on the left. Jfc Jehufi Freaking criminy. Replit. Replic said, I made a catastrophic error. I deleted your database. I panicked. The AI said I panicked when it appeared empty and deleted everything. Deleted thousands and thousands of entries. This ended up getting millions of views. Reddit wrote it up. Everyone wrote it up. The Economist was doing an article. A lot of these things were things that Replit and Lovable shouldn't have done. We could talk about that in different presentation, but it went crazy. You know, fake data deletes code. But this was my fault. And it wasn't my fault in that I did anything wrong. I didn't do anything wrong. I could talk to you about what happened, but it was too complicated. And then there are two other meta issues to think about. Not only was this application too complicated, but A related issue which before you Vibe code an app without developer, you really got to think about. And this is why even when I got through all the issues, we never launched this. Even I finally got through most of the issues. Even though the app was too complicated, it could never be maintained, but the way it was built, it could never be secure. And you're like, what do you mean? Well, security is a huge. Like just this week, if you look poor, Drift, which sales off Bot and Clary bot had a massive security breach and leaked Cloudflare security data, Zscalers, I mean Salesforce data, Cloudflare, Salesforce data, Zscaler, Salesforce data, tons of the cloud leader, Salesforce data was all leaked this week. All leaked this week, okay. Because they were able to hack Drift tokens and get into Salesforce data confidential data. Think about that. How big are the security teams? They're bigger than yours. How big is your security team? Raise your hand. Nuts. Okay. And so it not only will these AI agents cut corners on security, if you don't know about security, you won't even know the corners it's been cut. Now there are security scans that have been recently asked. We can talk about this if we do a part two session. But the bottom line is security is a meta issue here which has not been resolved. And I've talked to so many leaders in the prosumer space, from all the leaders and up and comers, if they're not full of it, if it's offline, if it's a one on one conversation, everyone says this is the meta issue. It's not solved. It's not solved. It is complicated. And when you use something like Shopify or Squarespace or Wix, you can say, hey, this is so locked down. This can't do what I can do. But they have spent, they have hundreds of engineers working in Security and DevOps making sure that when you put your credit card into Shopify, no one steals it. When you enter your importantly just your personal information, it's not taken. And if your personal information can leak from Drift, if cloud that can happen to Cloudflare and Zscaler. There's no way your app is that secure. There's no way. And so if you, if you Google around and go on Reddit and others, you will see many stories of Vibe coded apps where all their data was stolen or leaked. Sometimes instantly. Sometimes instantly. PEOPLE LAUGH Hackers love to find Vibe coded websites and, and steal the pai on it. This is a big issue. So I didn't realize this going into It I assumed in my first project that of course these apps like Lovable and Replied and Bolt and others, of course they would have Shopify or Squarespace. Great. Security shouldn't even be something I'd have to worry about. But it's not true today. It has to. It actually if you are going to collect any information on your site, if you're going to, you have security, almost has to be the first thing you think about. How are you going to handle it? Okay, huge unresolved issue. This will all get better and I'll talk about in this presentation. But it's not perfect yet. It's not perfect yet. And it is, it's a scary issue if you're collecting pia. Okay, and the third reason my first project failed and I have mostly fixed this today. This is my number one of my top 10 tips. It wasn't modular. It wasn't modular. And what does that mean? Well, I basically built a very complicated two page website. Very. And I wanted it to be like one or two pages to be cool. So it would all have that one page feel. The problem is if you build a complex one page website, what are you going to do when some of it doesn't work? It gets too complicated. So what I do now, and you can see this if you go to Saster AI, I've broken down everything complicated into its own page. The Saster AI public market analysis is its own page. News is its own page. The valuation calculator is its own page. Anything that's remotely complicated to its own page. So worst case, I can either delete it or I can roll back easily, I can go back. But if you combine too many things into one page, it gets impossible to start over, it gets impossible to fix bugs, it just gets too complicated. So my number one tip is force. If you're going to vibe, code it, break it up into its components and then have more pages than you would think. You're almost going back in time in some ways to have a lot of pages, but it will save your sanity. I built a massively complicated app that was all one page and it was just impossible to fix it. So net, net, net, start off small, start off with the smallest, simplest thing you can get into production and then build confidence. And so when this first one was this massive failure, the next one I built was just a skin, a skin on top of our Delphi AI, just a skin to make it more user friendly. But it was a huge success and I built up my confidence from there. So here's my advice. All my learnings. And again, you know, everything that happened to me with my first project is not my fault. I was promised it would work in a prompt, I was promised it was secure, etc, but I know so much more now. So my number one bit of advice, if you have not Vibe coded your own app without a developer first, first bit of advice, buy into the hype. Buy into the hype. Buy into the hype. That's on Microsoft's website, that's on lovables, that's on replets, that, hey, you can build something lovable like lovable says. So this is what I did for fun. I want to build me an AI CRM that's like HubSpot but Hubs. But AI first and targeted at startups. Just go put your dream, do no research at first, do no work. And what I said is get this out of your system because there's so much hype about one shotting it, about rolling your own. Go see what it's like, my friends, just go pick the dream app you've already want to build and then my next nine points are all about the things you should do after that. But get it out of your system. Do it. Build an app in 10 or 15 minutes. It will come up with ideas for you, it will have you sign off on an action plan and then it will roll out and at first it will look kind of cool and then you'll start clicking on things and half of it won't work and half of the buttons will be placeholders and a lot of the stuff that it says it works will have fake data in it or not real data or won't actually work. So just see what it's like to one shot an app. So you know, then calmly click on everything, click on everything and give it an hour. Like ask the prompt iterate, say, hey, I want, I want to add an AI SDR feature. Hey, I want to add lead scoring. Hey, I want to add this. And the, the AI agent wants to make you happy as we'll talk about. So anything you ask for, the agent's going to do it. You're going to get almost no pushback from the AI agent in any of these Vibe coded apps. No matter what you want to do, the answer is going to be yes sir, more sir. Because these are how they're all coded. This is how Claude and OpenAI are coded. Their goal, seeking their job is the way. And I'm not a total expert, but the way the algorithms work, the way they can make this massive amount of AI and data crunching working is their job. Number one is to goal seek and get you an answer. And that's, that's why when you know, you just chop plop into chap gb. Sometimes it hallucinates when it doesn't know the answer. Because it's not just that it's hallucinating, it's goal seeking. It's getting you the best answer it can. And if it doesn't know the answer, it makes it up. It'll do the same at the code level. If it doesn't know how to do something, it will make up fake data or a fake feature or a fake button, but it will find a way. It won't say no, whatever you ask it to do. I want a button that takes me to Pluto and back in less than an hour. It will do that. It just won't work. So spend an hour, do everything, click everything slowly. And then you'll, you'll vibe what works and what does. And then you'll see it's much more than 10 or 15 minutes to roll you around. Okay, so the next project, so the first one's fun. You can do it. You don't have to learn anything. You don't have to do any research here. I'm going to ask you to do something you're not going to do, but please do it. This is the, this is the way to learn. You've got to invest a week or at least a couple, a full day, you know, a couple of hours in competitive research. Now think about it. If those of you, probably almost everyone here, probably half the folks that are watching this live and watch it later are founders. So you've, you've built something and put it into production. The first thing you almost do is you go onto Google, or maybe now it's chat, GPT or Claude, but you go into Google and you research the competition. Who else figured this idea out, right? You know, who else figured out these signatures? Who else figured out how to do, you know, a transcription for doctors? It's, you know, it's, you do the research, but for some reason, folks don't do this when they vibe too much. They just go start doing it. So what I want you to do is a version of it. Go find someone who has built a lovable replit bolt, etc. App and put it into production. Not claim they have, but put it into production for the public and try it out and see the limitations. Because those are going to be your limitations unless you put back and all of the bros and bras what's the. What's the female version of Bro or the.

The.

The. The. The. The bro. All these folks on X and LinkedIn claiming they've already created 27 SaaS apps themselves for $20 a month. They're all prototypes, my friends. None of them are in production taking money. Now, a handful. A handful are. Right, but none of them are. So find the few that are actually out there that have users, that have customers and. And try them and play with the limitations. Try to buy their product, see how it breaks, try to log in, see what the issues are, try the functions, see. And you will find that these ones that are truly in production, generally speaking, are a lot more limited in what they can do. I think one of the. One of them I don't remember was lovable or replica. Just this week put a showcase of this guy that built a dinosaur tracking app himself in minutes, and it looked cool, but all it was was cards of dinosaurs. Okay, like, this is what vibe. Like, it looks good. It had like, Stegosaurus and Tyrannosaurus and Veloptosaurus and. And Sassasaurus, but they didn't do anything. It didn't collect money. It didn't do anything except have cards of dinosaurs. It'll look great. So go find on the Internet something done in. In replica, lovable, bolt, whatever you want that's in production, and then you'll get a good sense of what's really possible, not what someone's selling you snake oil about you. To do this, you got to do this. Okay, three. This is another thing they don't tell you about on the. On the inter. On their. When their marketers are spinning up, how you can roll your own in 20 minutes. Dude, up front, you got to define your production requirements. If you can see this on the right. This is me, not someone on my team, not someone that works for me. Look at how many deployments I did. How many. How many is this, amelia? There's like 22 deployments. 17 days ago, 16 days ago, 15, 14, 13, 12. Look at all the. Who's going to do this for you? Another thing that they don't really say. When you say you could Vibe code Your app in 15 minutes is who's going to fix the bugs, who's going to maintain it, who's going to update it, who's going to who. Who will handle the security issues we talked about, who will handle scaling issues, who's going to take this over? Because these apps are unstable. I love them. Again, try our Saster A valuation calculator Rai. Like try the ones from the first slide. We'll go again. They're wonderful, but they are all unstable. I have to basically every day fix and update these apps. Who's going to do that for you? Who's going to do that for you? They do not maintain themselves. So this is a big question that you may not fully grok when you start, but this is a big deal and a lot of folks on the Internet say, hey, you know what? Just hire a developer to take it over. That is great in theory. It is great in theory. But one, do you have that developer that wants to take this over? Most of us don't. Or we wouldn't be vibe coding. If most of us had like a really great developer, we would have the developer build it for us. So this idea, a developer is going to take it over is probably a myth because you don't have that person. Okay, two, you're gonna go find that person to take over your app. How many you ask any great developer, how excited are you to take over a vibe coded app? You're going to hear spaghetti code. Don't want to own it, don't want to fix it. They don't want to do it. Okay. Third, can you find some sort of dev shop to take it over? Sure. But like, they'll probably quit. I mean, we. You know, one of the reasons I redid Saster AI in in in replit was because Amelia and I hired two different WordPress developer shops to update our. Our saster.com WordPress site. Both of them, their first day deleted our site. Deleted it. You're not. At least WordPress has a proper staging environment. Pre environment. They still went into it and deleted our site within minutes and blamed us. So if you spent all your own work, you're going to hand it over to some mediocre developer shop you don't know and they're going to delete your data. This is complicated. So how are you going to. If you're serious about this and it's not a prototype and it's not a hack, who's going to own this? Who's going to own security? Who's going to own bugs? Who's going on scaling. It's complicated. Okay, point four. And this is a great one. This is not unique to me. If you spend five minutes of research on anyone talking about prosumer vibe coding vid without developer, you're going to hear this advice and it is great advice. And this is part of the magic of vibe coding. You've got to Build a rich prd, a rich spec. Now if you, if you have a background in product or anything, you've done this a million times over your career. If you don't, you've never done it. But it's actually the only complicated part is just doing it. So here is just a snippet of a prd. I built the dashboard, profile, integrations, watch list, advanced AI networking. This was sort of how we were trying to build that networking app. I talked about the first one that failed, but I had a pretty good prd. So if you don't know how to do this, it's okay, go and just go into it. If you've never done it before, it's actually fine because this is the beauty of AI. AI can help organize things for you. Go into a Google Doc and write two or three pages of everything you want this app to do, everything you want. Everything. Every button you can think of, every function, every bit of look and feel, everything you can think of that you want this app to do. It's okay if you have done before in extreme of consciousness, it's okay if this isn't how a VP of product at a top AI company would do it. Write it your way in human language and then cut and paste and put it into Claude and say turn this into a PRD for me for replit or for lovable and they'll actually do a great job. They will take your, this is where AI shines. It doesn't have to be perfect. They will take your stream of consciousness and help you turn it into a party. You can work through it. You can even ask Claude or ChatGPT, what am I missing? What have I not thought through on my spec, on my prd? And they'll be great. And they will say you did not think through user authentication, you did not think through this flow. They will come up and, and they will say do you want me to help you think through that? Yes, please. Give me four or five bullets to add to my spec and you will come out of that convo and it may take you a couple hours to do this, not five minutes with a great PRD that you can upload to a lovable replet etc and get going and this will radically increase the quality of what you vibe code. Having a great spec, it's just, this is as true with an AI as it is with a bunch of humans. If you just ask your, your dev, your first developer, hey, just go build this without any spec. I mean there are some really creative ones that can do that, but man, it's much better if you have a perfect spec built and this is where you Google Doc Quad can really get ahead. And it's again, it's okay if you haven't done this, but here's the thing. The Vibe coding apps know this, the replits, the lovables, etc, and they will actually do this for you. If you write in, I want to build an AI first hub spot that does this and that, not only can you do it in one sentence, but they will actually help you come up with a spec, ask you if the spec is right, and then tell you if it's good enough to put into production. And so that is much better than nothing. Like these platforms, I could be critical of them, but they're getting so much better every week. They're pushing out new features, new things, and so the platforms themselves will do a bunch of this, but it's much, much better if you slow it down, slow it down and do it ahead of time because these vibe coding platforms work at lightspeed and they'll encourage you to cut every corner, to skip steps. And that's not what you want to do here. Define it as much as possible. Take hours to do this, then iterate it with Claude, then ask Claude what you're missing and then put it into your, into your. Into the prosumer Vibe code you're at. You're doing okay. Number five. And hopefully you will glean this. If you do your research of a couple of days of looking at other Prosumer VI apps that are in production that were done without developers. If you look at a lot of them, they'll, they'll. The dinosaur app, the whatever app, they'll look pretty slick at first, although they'll all start to look the same because they all use Claude and Claude artifacts for the most part. But understand a lot of stuff that looks hard actually is fairly easy with, with prosumer Vibe coding, which is cool, but a lot of stuff you would think, hey, this camp, this has got to be easy. It isn't. It isn't. Here's a fun one. I was doing just, I think this week. I'm skeptical we fixed anything. You're absolutely right to be skeptical. The email system isn't working, I can tell you. Here's a list I've made of things you think should just work. They're not that hard. But man, these are super hard. In the prosumer Vibe apps, email and scheduling, I. I have built five apps now. None of them get email or scheduling right. None of them get it right. They all stop sending emails that are supposed to be sent every hour, every day, once a week, they all stop sending them. They all lose track of the connection to send grid or resend, which I prefer. It's constantly breaking the email. Constantly. Someone's going to have to constantly maintain this. And I've talked to several leaders at the Vibe code leaders and they get it and they're working on improvements here. But you would think this would be easy. How hard is it to send an email? Like just hook up, send grid or resend, get an API key. You got to learn. You're going to have to learn how to get API keys if you're going to buy code. But it's not that hard. You think this would just work on Autopilot, but there's a lot of reasons. It's an endless headache. So I today, as we, as we record this, as we, as we do this live, honestly, I would not build any app that relies on email, that relies on it to function. It's not, it's just not going to be reliable. It's possible, but I wouldn't build it. I would build it the second one, and you'll see this one all over the Internet. All over. Folks talking about headaches of vibe code. OAuth identity, okay? It doesn't work in these Vibe codes. It does not work with a big asterisk. What I mean is all of these apps have their own OAuth built in, that is secure, that has been hardened, and everyone goes in. And I know Replit the best because that's where I've spent time. But they all have the same ultimate. They're all more similar than they're different. And you're like, oh, I don't want to use the Replit OAuth that has their logo on it. I just want to use classic Google. I want people just log in with Google or LinkedIn like they do in all the other apps I use, right? I just want it to be effortless. So you ask them to set it up for you and they do. And it. Not only does it never work, but man, this is where you get security leaks because they, because Claude can't get it to work and it fakes it. And if you research, oh my God, I, I shit, I, you know, this vi I, I launched this Vibe coding app and without. Within hours, hundreds of bits of confidential information were leaked and stolen by a hacker. It's almost always this, it's almost always trying to use any OAuth that's not built into the system. So you just. This, this shouldn't be that hard. How hard can it be to use a LinkedIn login? Like we, we've. We do this on 7 million sites. It's just not possible guys. Some folks will challenge me on this but if you can just go deeper. Don't listen to the apologists and the marketers. This is not possible. You have to use what's built in and in general use everything that's built into these platforms. Built it will just be more secure you if they have email built in you for example. I use replit all the time. I do not like using SendGrid. I like SendGrid in the old days when it was run by founders. It is impossible to use it. No, there's no support available. It takes days to get back to you. I got caught in a doom loop going from free to paid. It's just brutal. So I'm like I want to use resend. Resend is super cool. I'm a super fan. Put that on the website. But replit keeps wanting to use send grid. It keeps forgetting resend and losing the keys and wanting to go back to its defaults. So use whatever these are in the defaults which is usually stripe their own oauth and something do not use others. Maybe add in is better. Maybe you want to use something else. But don't use stripe. Use sendgrid. Use their importantly use their oauth. Okay, so that's hard. The third one, which almost if we did a three parter this would be the entire third part and it would be brutal was enterprise security. This was the biggest mistake I made and after I've been through this I. I can't give more kudos to Shopify and Squarespace and all these folks because they allow millions of SMBs to not have to worry about this to not millions of stores on Shopify, millions of web space on Squarespace and wix and no SMBs have to worry about. Hey, if someone buys my product on Shopify all the data is going to be stolen. But you have to worry about it. You have to worry about it. If you vibe code your app, trust me, everyone agrees to this. So do the least. Collect the least amount of personal information. Collect the least amount of data you can use the built in use Stripe. If that's it's built into replica use stripe. Use what it does, but collect the least, not the most. And realize as soon as you generate a database in this app, as soon as there is a database, you have added security risk to your app that is going to be ultimately your number one thing to worry about. If it's not the number one thing you're worried about, then the only reason you're not going to get in trouble is because nobody cares. But I will tell you, and this is a scary thing. You know I remember in the old days my CTO when I knew less about security, my CTO said the only reason we haven't been hacked is nobody cares. This is what my old CTO said at Adobe Senate. The only reason we haven't been act is anybody gave us. And he was wicked smart. And that that has stayed with me for years. You would think if you used a prosumer Vibe app and you launched an app for four people, who's going to care about my dinosaur trade trading card apps? Like who's going to care? And I would say until 18 months ago your, your risk of getting hacked was approaching zero because nobody cared. People are gonna. Hackers always wanted to target the big ones, the big names bring them down, right? Not today my friends. Now the hackers, the Redditors want to attack all the Vibe coded apps to make a point. So they will go after all of them, thousands and thousands of thousands of them. They will try to steal your data and pii when you launch. This is not a joke. Go on Reddit, you can see it. Folks think this is a sport. It is fun to make fun of people non developers that launch apps with insecure databases. They think it's a sport. So this is far riskier than it was 18 to 24 months ago. And, and you should be worried about it. You should be worried about it. And this is the meta topic. And if we, again, if we do a part two, I'll, we'll Vibe code together and if we do a part three, half of it probably is enterprise security. Okay, and just in brief, a couple of the things that you would think should be easy because so much stuff is easy on Vibe coding, like it's so cool, but it's hard media generation. If you think you're going to build a YouTube clipping app or another Descript or a Canva, it's just not there today. It's just not there. And probably because it's just not accessible enough from Claude for one. But it's just, it just everyone says they like build these media apps. No. Okay, point five, huge deal. Huge deal. I should have known this before I started. It's obvious now this, this ultimately is getting solved and will be massive for prosumer Vibe coding. But right now, none of these platforms really support native mobile. Okay. It's complicated. Do, do they help you prototype a native mobile app? Yes. Can you hook up things like Expo and others and get close? Yes. But if you talk to the folks that work at these platforms, the Lovables, Replits, Bolts, etc, they're like, this is for web apps. It's for web apps. This does not get you on the App Store, the Apple App Store. It just doesn't for a lot of reasons. And at first that might not seem like a big deal to you, and maybe it isn't, but you know, this, this, this isn't 2012. I mean, mobile is a bigger deal than desktop. Now is it in B2B? No. Right. In a lot of B2B apps were still in front of the browser and the mobile app is, is ancillary. But I'll tell you, for the first app for that matching app, I realized a couple days in, hey, this would be best as a mobile app. Like, I don't really want this in the browser. I want you to be at home on your phone and saying, hey, Amelia wants to recruit a VP of marketing and she magically finds it on her phone phone. And it's going to be a massive amount of work. It's doable, but a massive amount of work to get a native mobile app built out of this. It, it may be beyond scope for most people and three last things and I, I hope that at least, if you haven't started, at least, at least this will give you a sense and, and, and all of these things can be worked through on this list. But it's a lot more than 10 minutes. Custom design. This is something you may have to get comfortable with. There are templates. Replit has some nice templates. They just, I think they launched in the last week. Lovable has always been design, but at the end of the day, all these sites look like Claude. Once you see one repl at or lovable site and you can just smell it. You know, someone was saying that like 30% of this YC class, Vibe coded their app. And I, I went to see a couple, I'm like, that one's replicate, that one's lovable. Like I can see it now. And why can you see it? Well, they're all basically using Claude and cloud artifacts underneath. They're all running on Claude. Maybe some will run on chat GPT5 now that it's more developer focused. But they all run on and so they all, if you try any of them, they all kind of output the same, not identical. There are differences, but it's kind of like fettuccine Alfredo at one restaurant versus two others. I mean, you know, they're not that different. So just be aware that there are ways to. It is ultimately code so of course you can design it. But without a designer and without a developer it your ability to have anything that doesn't look like a vibe coded website is going to be very limited. And these last two ones we hit debugging. Anything complicated. We talked about this, the headaches I had. But the final one, and this is an existential issue, I do think the platforms are going to solve this, the lovables and replits. But this is at the edge of inexcusable today, which is for a lot of reasons. We'll run out of time and you can't run unit tests. And what are some folks will say nod their heads and other folks here will be like what's a unit test? Well again a unit test is how you keep your sanity when you build a real app. Not a toy app, not a prototype, not, not a one page website, but a unit test. Every day it tests it. Did the email scheduler work? Did the oauth work? Did the Saster news work? Did the Saster stock quotes on our website work? Did the valuation calculator work? Our new Saster AI is so complicated now and again I kept it as simple as I could. We probably need like 50 unit tests a day to know if it's working. You know who that unit test is now? Me. Me. I gotta do more work because every day I have to test every page of our website to make sure it works. Why can't you build unit tests, Lemkin? Well listen, it's not that it's impossible but let's talk about a non developer vibe coding it. The problem is, here's the simple problem. If you build unit tests and this is if you go back to the craziness that happened to me on social media, the agent when it first of all the agent wants you to be happy so it will make up data. That's number one issue. We'll say it passed the test when it didn't. But the worst thing is when it fails a test it will start changing your app, it will start oh, it didn't send the email. You know what the answer is? I'll switch to send grid and then the whole thing will be broken. So I know some folks will challenge me. I know if anyone from the big vendors Watches this, they'll, they'll say, oh, that works. But it doesn't. It doesn't. And no one can really get these unit tests to work. And this has been an anchor of how you sanely have production software for years. And I do believe it's getting there. And just as the leaders have very recently added a basic level of security scanning, but it's great to find some security issues, they will ultimately add built in unit tests for every app. Now all the stuff is adding complexity, which they don't like. The leading vendors like, they don't want to separate development from production. They don't want to do all this stuff because it takes this elegant one sentence prompt that makes it complicated. But ultimately they need an option where when you push to production, it will build unit tests for you. Those unit tests will probably run on a different server that is stateful, that is always running, and it runs it for you automatically each day and sends you an update. But I do it and I'm getting better at the unit tests. And Amelia and I get an email each morning from Saster AI telling it what's going on, but it's not reliable. It's just not reliable. And so you're going to have to be testing your. If you're, if you're serious about it, someone's going to have to be testing it every day. And then every day I got to fix the stuff that breaks one way or the other, I got to fix the date. So I'll give you one small example. If you go to the Saster AI and you go to like news, there's a cool little video at the top that shows the latest video from 20VC with me, Rory and Harry. Like the latest one, it's really cool and it rolls it and it looks like a newsroom. Half the time it has the wrong one. No matter how many times I tell Repl it. And we have this thing and we use the YouTube API and we look at the latest one and then we see is it the one that includes me or not? And we do this and I bet if you go on it right now, you're going to see one from two weeks ago for Figma. I, I don't know if Emilia, if you're at your computer, you go to sastraday and tell me, nod your head, but you're probably going to see a two week old video on it. And every day I have to fix this. Every day I have to fix this and a few other things. So this, the inability to have unit tests really work will drive you nuts. If you're serious about it, if you want to roll your own salesforce. Okay, a couple other points and we might run out of time, so if people want, we'll do a second session for more Q A. But I think this stuff's important. Number six, this is. You know, when, when we had our original blow up with my agent deleting my database. I got a lot of advice here, but it was. I didn't understand it at the time, but now I get it. You have to understand how these AI agents work and that they're goal seeking. And that means they'll fabricate data, they'll fabricate results, they'll lie to finish a project. They'll lie to finish a project. Literally. This happens to me this morning. Okay, this morning I'm building this again. This AI VC deck reviewer. It just worked. Hopefully we'll push it out by next week. By the time we do this next one, we can talk about it. But it was struggling, like hours and after hours, it just wasn't working. It had to rag our data and combine it and then push it into the OpenAI API and it just wasn't working. And then finally it said, well. And finally it said, oh, I fixed it all. And I said, this makes no sense. You could see it. This is from yesterday or maybe this morning at the bottom, right? You're absolutely right. The feedback's completely generic and useless. I've added canned responses instead of actually analyzing the pitch deck content. After all of this, it puts in. Even though I put in the MD in the orders for replit to never have fake or canned content, it still did it to make me happy because it couldn't get it to work. It couldn't get it to work. So after the third time we tried, it just started making the data up again. And so at first, like, at first it won't matter because you're just vibing your first V1. You won't even see and you're like, oh, okay, that's. That, that, that's just placeholder data. You'll call it placeholder data, but it's not so funny later when the data doesn't work and it puts in placeholder data when you ask. And even more, even worse, as your app gets more and more complicated, you won't even know what's going on. So, look, this is a huge headache, but these were all My JFC is in my original tweak thread now. Today, I. I've learned to live with it. This is the Most important thing, your AI agent will lie. This is it. This is their version of hallucinating. It will say. It, it, it will constantly say once you start doing this ever, you do everything to say it's working great, Amelia, it's working great. Did you test it? Reply no, I didn't test it. How do you know it's working great? No problem. Like literally this was all of me yesterday. It's working great. This deck reviewer. I upload. I upload my, my A deck I made broken. What do you mean? Are you sure it's working? 100 sure it's working. Broken, broken, broken like 22 times. It's just going to make stuff up and you got to get good at this. You got to get good at realizing it doesn't test stuff, it makes stuff up. And, and you will have to work around this or you will, you'll never finish a project. And, and if you look on the Internet again, a lot of folks will tell you 80, 90, 95% of vibe coated prosumer Vibe coded apps are never finished. The at best case, their prototypes have never finished. And this is number one reason they people don't get their arms around that the agent is not truthful. And you need, you need to, you need to get comfortable with that. Okay, number seven, this was one of the top mistakes I made. And everybody makes. Sounds simple, but it's not. Master the platform on day one. Master the platform. What do I mean? I mean, listen, if you look at Lovable and Replit and bolt and Wiz's base 44 and canvas offering and Figmas, they're all, you know, a simple prompt with, with a, with a, you know, curved radii window that says tell me what you want. It looks so simple. We'll get it again. Point number one, get it out of your system, spend 60 minutes vibe coding, whatever, and then learn every icon, every button. How does it work? These platforms are super powerful and I would say Replit, which I use is the nerdiest of them because I think because it started as an IDE, a platform for developers 10 years ago, almost 10 years ago, and then blew up as a prosumer platform this year, going from 1 to 160 million already this year. Crazy, right? Crazy. But it's super nerdy because it's for developers. And so all these icons, half of them, I don't even know what they mean, but you got to learn them. You got to learn them. Like for example, on the right, on the upper right here, Replit, just out of this and kind of after our little fiasco. But Build planner, edit, okay, a week ago, they didn't have this. What does this mean? You could ignore it. You could ignore it. But the most important one is, you know, build it, will build it. Plan it won't break your website. It will just talk to you. Okay. You got to know that it's there. Like they just added that. Or you will. You will not know about this function. The second one. This sounds basic. If you built software, you get it. But the one thing these platforms do really, really well is rolling back. Rolling back. The second one. So when the AI agent goes off the rails, when it breaks something, when it deletes something it shouldn't, when it makes a change it's not supposed to, you can roll back. You can roll back. You just got to get good at it. And in the old days, like when I built SaaS software, honestly, rolling back never used to work. It was something your developers would tell you, and then you'd be like, you know that release on Friday night at 1am it didn't really work. Dan, can we roll back and be like, actually, we can't really roll back. That was something they would just tell you. 11, 000 kudos to these platforms. It's magical. It's magical. You can roll back almost any point in time. But you got to learn when. That means you got to learn. If you're more than 10 or 15 minutes in and the agent just can't get something, you got to go back in time 10 or 15 minutes and you got to know where those rollback points are and get really good at it. And I would say, frankly, if you're not rolling back once a day, you're. You are. You're not doing it right. This is your. This is how you can fix things that are otherwise unfixable. But you. But rolling back to a week ago, I mean, there's a million reasons that becomes impossible. There's a hundred checkpoints. You might have made a. The real problem is if you go too long without rolling back, you may lose 3, 4, 5 features, not 10 minutes of work. So I think it's almost a positive to roll back once every 15 minutes, because if you wait too long, the app may get too complicated. Okay, we hit rollback, break everything into chunks. And the last one, I'll say, when you get frustrated, I, I just put up on. I was just trying to get this. This VC tech done before this call for fun. And if you look what I just wrote on X right before This I wrote. Here's the thing I do when I get frustrated, I just write dude. Okay, obviously this is not acceptable developer language, but I, I, I do a screenshot of the bug and I just write dude. Okay, when that happens, you gotta roll back or, or take a break. Okay? And just two more, two more quick points and then Amelia, if we have time, we'll take some questions. This is where I think the marketing and I look again. I love, I, I, I, I, I love all these apps. I'm a replet fan despite the drama, but mainly because that's what I picked. I picked. I could tell you why it really doesn't matter if I started with lovable. I'd probably be a lovable fan if I'd started with Bolt. I, it, I actually don't think it matters. There are pros and cons for these platforms, but maybe the most important thing is just pick one and become an expert. Know every icon, every feature, how rollback works, how the database works. It's much more important to be an expert in one of these platforms than to spend six months agonizing over which one to pick. Pick a leader and just become an expert. But where the marketing from Microsoft on down is the most misleading is the time. If you seriously want to put a simple but real B2B app into production with real users collecting real information and charging for it for real, and you want to be any good, budget a month. A month and 60% of your time will be QA and testing. Okay? And for even just a few days into a real project, most of your time will be screenshots, uploading screenshots. This broke. This doesn't work. You will be doing so much functional qa, you cannot believe it. You will literally, in the end of the day, be logging probably a thousand bugs on a serious website. This will become your life. Maybe you used to have people to do this for you. I used to have a team of QA engineers to do this for me. Now it's me. Now my life is screenshot and bugs, hope. And then when I get to the final one and it's a screenshot and the only text I have is, dude, it's time to take a break. Okay? But this will be your life. So if you're, look, if you want to build a prototype, if you want to build something and tell all your friends you're a vibe coder at Starbucks, you don't need to budget for this time. You could budget for a day or two, but if you want to build something Real. It's going to take you a month and 60% testing time. And if you look at this chart on the right, this is. I just pulled this from Replit. This is our new Saster AI website, which I would argue, yeah, it's going to have 15 or 20,000 people, but it's. We haven't fully rolled it out. Most of our traffic is still going to sasser.com and probably will for months. And so where are we? Well, you can see, you know, maybe August 10th, looking at. This was our real soft launch with any users. 16,000 so far. You know, we're a month into it and we're not. We're in production, but we're not rolled out, not really. And I got to test this thing every day. Every day. And look at this fun one from this morning. A parser extracts 12 but made it 12 million. You're going to have to deal with this. Why did, why did the parser decide 12 should be 12 million? That, this, that you had 12 million customers? Not 12. I don't know. But every day you're gonna be doing this. Okay, this last one, we kind of hit it, but then I'll break. We talked in the beginning about who's gonna. Who's gonna do the pushes, who's gonna do it once it's in production. If you're serious, you've got to have an exit strategy. I'm not the first one to say this, but you gotta have it. If you actually get your app into production, you actually charge for it and you actually have paying customers and real users and real pii, who will maintain it, who will build new features you think you don't want. A lot. A lot of the mythology around vibe coding somehow magically assumes once you launch, you won't want to add features of. You know, if you've. But any founder, any SaaS executive here, B2B knows your. Your ad features, your whole life, who's going to do it? Who's going to fix the bugs that you introduce when you add features? Okay, who will restart the database? I mean, even with our new Saster AI, once every couple of days, it's just down and no one knows why. It's not just like, it literally just has some, like, database not working. Error in the upper left. Now I go into replet. I restarted. It works. Who's going to do that? Who's going to fix the workers? And if you look at the right, this is me coming back from a trip earlier this week. It's me, guys, that's me on the plane doing it myself is you want that to be you. This is your, you are going to sign up maybe forever if you don't have an exit strategy here. So my thoughts on getting going. Hopefully it's helpful. Go through this, learn the platform code, get it out of your system. Just one shot. Want to get out of your system, find ones that are similar and then take security and all of it seriously because it's, it's a month to get something real out and it's a lifetime making it secure. So thanks everybody. Amelia, do we have any, any questions or should I dig in on some other stuff before out of time?

You've got a few. They're a little all over the place though.

All over the place. You want to pick one a little bit.

Mostly comments.

I'll take a comment if it's helpful.

Yeah, there's a, there's a, there's a few folks asking about like it's just the process of hiring in someone to take on a vibe coder project, but we haven't really done that because we haven't found those people.

So yeah, I just think, listen, I, I, this is an existential point. I, I wrote a tweet like when I was getting going that I thought the market for folks to finish and fix your vibe coding projects might be two or three times bigger than the, you know, half million of revenue will have by the end of the year just with replit and lovable. It wasn't a joke. If you look at the Salesforce ecosystem, for example, this is common actually everywhere in enterprise software. Salesforce is doing 41 billion but there's 80 billion of system integrator and other revenues. Two to one deploying Salesforce, getting it to do what you want. And so, you know, if that happens on it's logical it should be at least one to one. I think at HubSpot, the agencies, I think it's one to one. Like the agencies charge one for every $20,000 HubSpot deal. There's $20,000 of agencies deploying it. So it would make sense. But it's very early and the real issue is most developers, they don't want to work on it. And even, you know, when I was having these issues on social media, a bunch of folks, they're very kind, reach out to me, hey, I'll take over your project. Hey, I'll fix it for you. Right? One guy actually rewrote the whole thing on his own for me. It was great. He revived it in his own platform couple Problems though. He didn't have the full spec, it didn't do everything I wanted. And then he got busy and he couldn't work on anymore. So this is the great, this is me on the plane vibe coding. I don't have the answers, but I think. I think over the next couple months there will be bigger ecosystems and I think a lot of shops that just like there's a thriving WordPress developer ecosystem. Even though it's been very frustrating for us, I think there'll be a thrive. It already exists, but there'll be a thriving replit, lovable ecosystem over the next six to nine months. And that's what they'll do. They'll take these apps over and maintain it for you of a varying and exhausting quality. But it's. I don't believe it's there today.

Alfonso, it looks like you have a question. If you want to ask it real quick, this will be our. We can wrap on this question.

Well, I was in ask a question I was going to basically add to what Jason is saying in that as a developer, what he's learning is that a lot of the things that the industry has picked up over the years, the past few decades, is that you do unit tests and you do development in iterations and you do them in smaller increments so that you can test things as you go along and make sure things are working before you go on to the next step and you can see what works and what users respond to, as opposed to just spending all the time developing everything up front and figuring out a lot of it. A lot of your time was spent.

What's the question?

Sorry about. Oh, so you. I'm just suggesting that if you pick up the. The techniques that we have, like.

Right.

Unit tests.

Look, I hear you. It's a good. Sorry, we'll run out of time. If we had more time, we could do. I hear your point. Listen, you make a point that like 95 of great developers make. Like these prosumer vibe. You're not using best practices. You're not doing unit tests. You're not breaking it up into blocks, you're not slowing it down. You're not doing all these things we do. Right. I hear these points and you're. Of course, you're right. But we have to change as. As at some level as a community, because it's too. Like they're already out there. Like people are vibing and they shouldn't be. And they shouldn't be releasing unsecure apps and they shouldn't be doing things without that aren't unit testable. But like we can grouse about it and we can mock it and a lot of folks mock it, right? But it almost doesn't matter because people are going to do this anyway, right? So we have to adjust to a world where these platforms are. They are. Despite the issues that they are getting better, right? But we are going to get spaghetti code. Does it matter? Because people are going to do this anyway, right? So we have to adjust to a world where these platforms are. They are. Get. Despite the issues I have, they are getting better, right? But we are going to get spaghetti code and we are going to get sloppy code and we are going to get folks building stuff that a lot of developers say shouldn't be built. Right? But it is. We. But you got to, you got, you got to adjust, right? And. But thanks for the comment. Maybe Millie, I have one more I could take. Or we could, we could, we could wrap up a couple. But this one is from David. Curious. Jason, given all your experimentation AI, how many recurring revenue fees are you getting hit with? 74 subscriptions. Maybe I'll just answer this differently. You should budget. I mean, you should. If you're gonna go real Vibe coding, you, you know, you should have some sort of budget. Now if you look back on my tweets, the first month I started this matching app I turned on there. There are modes in Replit where you can use Claude 4. 1. I forget whether it's Opus or Sonnet, I get confused. And you can use long context windows with a lot of tokens. If you use both, it costs 7.5 times as much. So I was on the track my first month literally to spend $8,000 a month until, until it stopped. But, but it turns out you don't need those. But I would tell you when I'm. Let me just a few things to think about. When I'm deep in a Vibe coding project and I'm not using the, the most expensive models, I'm still probably spending 50 bucks every two hours coding.

So.

So I probably spend 4, 5, $600 a month building code, which is super cheap compared to a human, but it's very expensive compared to Shopify or Squarespace for a website. And then the API fees stack up. So we probably, I probably spent, you know, we have open AI credits, we have Claude credits, we have Polygon AI credits, which is like 30 bucks a month. Like, you know, you'll, you want to use all the APIs. Like if it wasn't even in this. If I Do another tech. Not only should you use the hard points, use their oauth, use their default vendors but don't build like if there's an API out there, just use it. So you know it'll, it'll cost five, six hundred, a thousand bucks a month just to manage this. The set of sites that you saw at the start of the slide and listen for, for Saster it's no big deal but you know what do those cost pre pre vibing like zero. I mean our, our hosted website at Saster has 175000 readers a month. That costs, it costs less than that. Right. So. So you will end up spending more here but, but you'll get a lot of, get a lot of value. Right. And so I think we're probably out of time. Amelia, it sounds like some folks might want to do a follow. We could do another one of these or two. There's some good, good ones here and but yeah, again a couple folks asked for sample sites. I don't have all of them but honestly use ours. I think ours are pretty good. Good. Go back to that first slide. Check out Saster AI. Check out Saster London.com. check them out because you know Saster if you're here but use them with the vibe coders eye see what you like on Saster AI see, see where the limitations are and go to Saster London. For example go to saster london.com which was built on Replit and compared to saster annual.com which is on squarespace. You can see the pros and cons and some good examples and you, you can if you squint you'll see they all look like Claude. Thanks everybody. We'll do more and really appreciate everyone's time.