LIVE: Top 10 Things We Learned from the New SaaStr AI with Jason Lemkin + Assistant UI

Blue sky, whatever streaming platform you're watching. Welcome back to Saster Workshop Wednesday. We're going to have some fun today. We are. We have a great guest and a great theme. A lot of you have noticed that we have launched our own AI, our own Saster AI. And it has been trained on a decade of our content and hundreds and hundreds of CEOs and speakers, and it's only been up for a month, but we've already had over 6,000 sessions on it, which is pretty crazy. And I wanted to do two things. I wanted to share my learnings because honestly, it is, to be honest, it has opened my eyes to how to think about what I can do in the real world, not just in SF pitches and even for coding and programming, but what it will really do for all of our apps in the role. It's open, so I want to share those 10 learnings. And then I was so excited about what this did. I was lucky enough to recently invest in a company called Assistant ui. And we have the CEO and founder here, Simon Farshed, who is. Has the leading platform to add a chat GBT like interface to your own app. Right. So I'm gonna have Simon here, I'm gonna introduce him in a second, but I'm gonna have him chime in on all my learnings and dig deep, a little deeper on the application technical side. But he's got. I'll show you in a minute. He's got 4,000 GitHub stars and a lot of great early customers on this and a lot of traction. So he's seen how these, this framework works and add it to your own app. So, Simon, thanks for joining us.

Thanks for having me.

Yes. And I'll introduce you a little bit more of the app in a second. But. And we'll share our learnings. But you guys probably saw this and I want to frame this slide. I know I talked to a lot of B2B founders and it's really only recently they're coming off the sidelines in AI. A lot of folks are talking about hallucinations, and I want to show you what we've learned in a minute. They're talking about security concerns. They're saying that there's. That our customers don't need cute cartoons. But I think the skepticism is fading away. And I think everyone's realizing whether they're in a space like support or, or. Or coding, which have already been profoundly changed. Profound. You know, almost half of support is done by AI in many cases. And a lot of leaders, as we've talked about are now completing about half of their programming in using AI tools like Cursor and Windsurf and others. Last week we showed, you know, one of my fastest growing investments, Revenue Cat. They've doubled their pull requests using AI tools. Right. So that's already happened. Others we've been skeptical. I don't. I think folks aren't skeptical anymore. HubSpot has launched its own tools. Everyone has. But to summarize, this is kind of crazy from Sam Altman. ChatGPT is just 26 months ago. A million users in five days. Now a million in an hour. I'm not sure how many orders of magnitude that is. Simon, can you help me calculate orders? It's a lot of orders of magnitude difference, isn't it?

Quite a lot of orders of access to three or four or something. Yeah.

So wherever you are, I think my learning from the Saster ui, wherever you are, there's something So I when I put this together was 5200 messages in a month. We precede, if you look on the right, we preceded it with how do I hire a great VP of sales? Should I come to Saster annual? How do I get funded? But people ask all different things. But if you think about it for a minute and we'll dig into it, we have almost 6,000 folks in less than 30 days. I could never have this many, could never have this many conversations. Simon couldn't. Right. So if nothing else, if you think about the scalability here of AI and we talk a lot about replacing humans and efficiency but in many cases it's about doing things there's no human to do. We don't have anyone at Saster that can have 6,000 founder conversations. Like we don't have any. But so but this is a lot of data and a lot of learnings and then we're going to get to it in a minute. But assistant UI just to frame the conversation. Simon, tell me what you've learned. What's changing? What's going on here? What have you learned from your customers in deploying this type of interface in their own app? Give us a 60 second summary of all the learning so far.

Totally. So I help developers add AI chat interfaces in their apps. The these interfaces look like ChatGPT and the developer can go and customize and add their own custom elements to the chat as well. When I started this I wasn't sure if there's going to be any market for this, but it turns out that the chat interface is really useful for agentic applications and that's what's been fueling the ChatGPT growth as well. Where it's like initially everyone was like, okay, it's nice and fancy, but how big of a use case is this chat going to be? But it turns out that you can do everything from image generation to controlling AI agents just from a chat interface and it turns out to be a pretty decent user interface for that as well. So the market ended up being much, much bigger than I thought for a product like this. Initially it was just going to be GPT wrappers, but I ended up people building complete AI agents that are controlled the entirety via chat interface.

Cool.

It's been a really fun journey. There's all sorts of long tail use cases that people use this product for because it's open source. And then I've been doubling down in a few niches, mostly around playing agents and adding agent UI in applications as well as a little bit in commerce and support use cases.

Cool. All right, well it's pretty cool. There is an open source version that you can use today, right? I mean you can use it all today. But if your team, if you're thinking about adding. I think I wasn't even sure about this 30 years ago. I think every single person right now should have some sort of chat GPT like interface, some sort of copilot, some sort of app. I don't care whether you're selling to salons or dog walkers or whether you're selling to the techies. It doesn't matter. Everyone, this is the way. We don't want to input data anymore. We don't want to hit refresh, we don't want to figure out the, the 11,000th UX that we don't understand. Like you've got to have this at least as an alternative. And again, literally the fact that 6,000 folks went to just saster websites and did this in one month shows you this is so, so, so take advantage of assisting ui. Check it out. Have your team check it out and challenge yourself. Can you just launch something this month? This is the. I hate this term cracked. I hate this term Cracked Simon but this is the area of the cracked engineer. Like don't wait to launch your AI for a year. Like use some look at assistant AI and other frameworks are out there. You don't have to do it from scratch. You don't, you don't have to build. You certainly don't have to build a model from scratch, right? You don't even have to build the chat framework from scratch, right? If your Engineers care. They can get this done in a week. You can get something up in a week. So do it because people, you're going to look pretty old school if you don't have anything like this very, very quickly. So just on how this works, our app, we use this app called Delphi AI Lenny uses it, Brian Halligan, founder of HubSpot uses it. A lot of kind of folks with a lot of, a lot of reach used Delphi. You can check it out and it's pretty interesting. And so here's a quick look at the back end that we've done. It's trained on. You can see it here. I know it's probably small and folks screen but you can see it's trained on 17.6 million words. I think that's a decent amount of content. It's 10,000 posts, 2100 YouTube including like you know, CEOs of wherever you know, Asana, HubSpot box, whatever. All of their Saster sessions. It is trained on 800 pods. Over the years, almost everybody in 100,000 tweets like it's a lot of content. And I want to, I want to get into the 10 points but I think my meta learning here, it's one of the points is how important training is because it's pretty good. If you talk to something in these 7.6 million words and I'll show an example a minute if you. My learning is. And I don't know why if exactly I sort of know why. If you just randomly Ask Claude or ChatGPT about this type of content, the answers are pretty mediocre. But if you do train your, Your app on 17.6 million, it's pretty epic. And this took. Listen, I'm not an expert in how long ingestion takes. Maybe you have some thoughts. Simon? It took hours to set this up right. It's a lot of content to ingest, in some cases to scrape. Right. I don't know exactly how it works in the back end whether you know but, but, but, but once it works it's pretty, pretty, pretty powerful. So this is how it works. And, and Simon, anything you want to add on that ingestion or that that's helpful on this?

I think it's a very good thing to point out that like all of these AI ch quite a little bit of data to work. So for Delphi's use case you're in this privileged position where you already have 17 million words about yourself readily available to ingest.

Yeah.

If you want to add some sort of AI assistant about your app, there's a likelihood that you don't have 17 million words about your product. The way you collect this is to just launch something really quick and collect data early on. Because the highest quality data that you can collect is the user questions and the user conversations people are having about your product. Those are like the perfect set to figure out what questions your chat bot really needs to answer.

Yeah.

Right.

90% of the questions are the same variants of the same 20 questions, right? Yeah, yeah, yeah. But unlike what's fascinating here, unlike a wiki, which can just list the same 20 questions, if you train it right and you ask variants of those questions, it's really good at giving you the right variant answer. It's pretty good at tailoring it. We'll have folks that come into our AI and say, listen, I'm at 3.6 million ARR, growing 34%. My customers are barbershops and tailors. My deal size is 5k. Here's the issue I'm having. And it can tailor the response pretty damn good to that in a way. You know, a knowledge base. Never could, never.

Yeah, exactly. And one more thing to point out is that like 90% of people, everyone's questions are going to be the same, but everyone asks 10% different questions.

Yeah.

And the magical experience is when you can answer those 10% as well.

Yeah.

So that's where having more data helps a lot as well.

Yeah. And it is interesting. I saw this in. I just wrote up writing on Freshworks at 800 million in revenue, which is one of the leading support and service public companies, and they talked about their AI and they said something related to this, that I've also seen a gorgeous ROM on the board which says 20,000 SMBs doing AI support do it. This is work. Right. This was a day. Right. Brian Halligan from Upstart trained his AI. He didn't have 17 million words, so it took him a week of training. Right, we'll talk about that. Um, freshwork said, you know, and gorgeous uses, too. The bigger the customer, the more successful the deployment is today. Because they have people to do the training. Right. A lot of SMBs have nobody. They just expect it to work AI. A lot of the. Like, this still took a day. Right. This did not. As great as. It's cool as this is, it does not work 100% out of the box. Like, I literally. I have a different site. I literally tried a similar tool that said it would do everything. Like, I didn't even have to set up the RSS Feeds or the links. It didn't work.

Like, we're not in the hot end of it. Yeah, yeah.

So it may take you 30 days to fully nail this ingestion and training process. Right. So you do have. You do. We have to commit to it, but. But if you do, it's magical. So this first one, guys, this is going. Simon kind of made a version this point, but this is really powerful for your apps or whatever you do. Folks will talk to our AI about things they won't talk to human about. Right here. I just did a search on everyone thinking of quitt quitting. Simon, you're a repeat founder. You ever had a moment where you thought about quitting? I have a brief moment. Never.

Couple.

Couple of times. Did you have anyone to. Honestly, did you have anyone to talk about it?

Sometimes, yes. But a lot of times it's also been journaling. Yeah, journaling, yeah, totally. These AI chapas are a tool for thought in a lot of ways, but.

We'Ve had a lot of conversations over the years on this. I've written about it. Ben Chestnut from mailchimp has talked about it. These ants. This is pretty good therapy. This is pretty good startup therapy right here, right? Amelia, have you ever thought about quitting? So you should say no. Have you ever thought about quitting once in a while for a brief moment? Once or twice over the years. Not. Not quitting, but I think there's times where it's, you know, I mean, these. I think I've seen the back end of our AI bot, right. So I know it a little bit more. But, like, I think it's. It's more cathartic that they can talk. Like, they can't talk to actual Jason. Like, you know, our team can talk to actual Jason. Like cathartic that they can talk to a version of you that's pretty good and base. I think your AI does pretty much tell people to keep going, right. Like to go long and it takes a while. But in those moments of weakness, it's nice that they can talk to digital Jason. It is not, I think, at the app for sure. And I think at the application level, my, my learning. My, my. Which I didn't know before, is if you do this right, if you make the interface really good, people will talk to you about things they otherwise wouldn't. Right. I've written a lot on Saster about how we just hate talking to customer success now they show up, they never want to fix our problems, and they just want to do upsell. We have no one to Talk to. At our largest vendors, we have no one to talk to. If your AI interface can really talk to you and work through these issues, that's very powerful. That is an example we would love. We have two vendors coming up for Saster annual everyone, come 5-13-15, the SFA, we have two vendors with problems. We can't get anyone to get our help. I would love to talk to an AI that is so good. Not only can it help solve my problems, but I would want to talk to it, right? So just look at this. These are conversations that would never happen.

The other version of this is like if you add this sort of chatbot to your B2B SaaS app, there's going to be support requests and issues and problems and customer insights that nobody would ever tell you directly, regardless of how many customer conversations you're going to have.

Yes. So yeah, yeah, I think as we do this, as we all get better, it is exactly. This will be in many ways like GONG on steroids. Just from, like, from Gong, which was so early to ML, we would learn what our sales team was saying. The right interface here should tell you things about your customers and products, otherwise you could never learn. That's a good point. You could never like go out and meet them in person. This is a SaaS team you've got. You'll learn things in person you'll never learn. Right? But you will learn if you nail this interface. You will learn things from your customers. You would never learn from a human support that takes an hour to get back to you or that doesn't want to solve your problem. You will learn things that you will never learn. Right. This one's pretty crazy. So our obviously the Saster AI is trained on everything I've said or talked about startups for 12 years. So this is from owner, one of the fastest growing companies at Saster Fund. We had it. We had all the board and investors provide feedback on their investment deck and the AI won. I won. It beat me, the real me. It beat Redpoint, it beat others. It had the best feedback and it did because it basically, for what it's worth, it basically said what I would have thought, but it didn't Forget. It remembered 12 years of my thinking and it had the best feedback on TAM team positioning, competition, markets. It was, it was really, really good and much better than I would get out of a generic, no matter what I get out of a generic Claude prompt or input. But it won. It won this. Right? So if you have. Folks have already done this, if you have A deck for investors. Upload it and ask the Saster AI what it thinks is. Is this. Is this what you'd expect, Simon? Is it crazy? What do you think about this?

I totally agree. I think there's another version of this which is like you're probably not going to work as hard as you could 24 7. And having an AI, it never loses focus. So it may perform better than you do 95% of the time, where if you really, really, really cared, you could probably do a better job than the AI. But most of the time in the average work you do, you don't do this.

You don't. Yeah, it's a good. It's. It's pretty. It's pretty. It's. Think of all the. It's pretty disruptive. I didn't expect this. This is better than us. This is better than all these fancy VCs. Not entirely, but overall, this was just from the other day from our AI. Okay, this one, I think is worth spending a few minutes on because this was a learning for me. Right. Everyone, especially folks that are not particularly technical or do not consider themselves prompt engineers, remembers the first time they fired up ChatGPT. And we just all made fun of hallucinations right in the very beginning. We would just get crazy answers. Right? And some of that has faded away. But so many founders I talk to are still skeptical about AI in their application because of hallucinations. And obviously the issues are still there. They are going away. Here are my meta learnings. And then Simon, tell me what. What you see. There is some. The. There are. I would say hallucinations are roughly. I don't have the exact data. Less than 5. I would say 80% of the time. Rai is really good. It's really good. And I'll show you some examples. 15% of the time it's meh. Right. It feels a little generic. Right. For whatever reason, maybe there aren't enough of those 18 million words to synthesize. I don't know why 15 are mad, but it feels like something anybody could write. Right? Not that's where it's unspecial and anyone can do it. And 5% of time it says something wrong and it's not that common, but I pulled two examples and it may be how. How it's interact, how it's interacting with the data you ingest and the APIs that it uses from the models. The one at the bottom left was someone asked for Saster Annual where. Where they can get a discounted. It added a strange answer that it would be at the Hilton Union Square rebranded Saster tower. That was 2018. So mostly it's done a good job in support. I'll show you an example in a slide. But this was pretty bad. Telling people to go to the venue from 2018. I give that an F. Right? And then this really weird thing. People ask sometimes creepy things about me, right? But they asked for about personal details. This entire story is manufactured. This whole story about me, that I'm about work, life, balance. I have three kids. I don't do emails when I'm on vacation. When I'm on vacation, I like to sit at the pool. I'm on social media all the time. Okay? And then this crazy story here, which is somebody else's story, this aunt's play and work and teaching a three year old to ride by visiting a grandmother and fast food. None of this is true. And I hate skiing. At the bottom it says I'm passionate about skiing. I mean, listen, when I was in college, I pretended to like skiing for the social reasons I. But I don't want to spend like a whole week skiing. I got to build stuff. Simon, we don't have patience for skiing, do we? Patience, Right. So. So these ones are crazy, but I guess, I guess this personal stuff is, is. It's making up. And this email address is wrong. But I would say these are the only two exceptions I can find. These were the worst ones I can find. I'll show you some others that were like a tier. But what's, what's the current learning on hallucinations that you see? Simon, from the field.

I think you can classify hallucinations and those that actually cause any harm and those that don't.

Yes.

And the user interface also really matters in terms of like how susceptible to hallucinations you are. So in a chat, you always have a human in the loop. Every AI response is read by a human. There are no automated actions being taken. So the worst thing that can happen is someone misunderstanding something. And the worst, worst case is someone going to the wrong venue of Sasser.

That's embarrassing.

Yeah. But you can probably classify what the overall shape of the risk is. What's the worst thing that could happen? And make sure that for those responses, the AI is doing a good job. And then when you have a chat interface, if the AI hallucinates random facts about you, it's probably not that big of a deal. Depends on how often it happens. But as long as the harm isn't that bad, the cost of hallucinations a lot of times in chat applications isn't that high because the end user ends up understanding at some point that, wait a second, this doesn't add up.

Let me ask you a different question. It has exceeded my expectations. The hallucinations are rare and they're usually random things are off point. Right. That they're off point like personal life or when people ask random things that, that probably aren't part of the 20 million words that we've ingested. But at a lay level, I think it's less than 5%. But do you think we'll get it down to less than 1% in the next 12 months? Do you think just using the tools and frameworks we have, it will go down almost another step function order of magnitude? Or do you think it will we'll have to just live with these types of issues?

I think it will go down like, if you look historically, the hallucinations have gone down tremendously.

Well, that's what I mean. Absolutely. Last nine months, down, down dramatically. Right.

And like most hallucinations happen around the AI dealing with your own custom data. So like ChatGPT used to hallucinate and I can't think of the last time where ChatGPT in its generic form hallucinated to me because it has so much training data. And then the only hallucinations I see is around rag, where the AI agents, instead of taking the data that you give, it uses a generic answer. And so that's a class of hallucinations we're currently seeing, but all the labs.

Have on the family stuff. Right.

So I totally think. So I totally think that this number is going to go down and the problem will fix itself.

Yes.

And there is going to be some point in time where we can finally say, okay, we can actually trust the answers of this AI to the same level that I would trust the real Jason to give me an answer.

Yeah.

And that will prevent us from having to double check every answer. And it's going to be a massive step change in how we use these AI assistants as well.

That's a good insight. And maybe that's. I can wrap this. I picked these two because they're wrong. But they're the. But it's been, you know, I can't, I'm not privy to all of them, but if it's two out of 6,000, it's not bad. Right. Or less than 5%. I actually think my, my shocking learning is not only are the hallucinations uncommon. Right. In most cases minor. Right. But I think for this AI that's trained on Saster information. It's already at your point. It's right so often that I don't believe I. We can do 6,000amonth without any human review. I think it's. I didn't know it would be right this often. Right. That's my epiphany. If it gets just 50 better. I think it would. These then would seem like anomalies. Right? They're close to anomalies. Right. Okay, here's the next one, which I admit I did not get until I was on the other side. This is a weird paradigm. Okay. But I'm combining. Brian Halligan, chairman of HubSpot, has done one as well, and he added video. I've decided for the moment not to add video. I think I will add video. We could talk about why. It's pretty interesting. I don't know what API it uses. Simon maybe you know, but it can see you when you're on video. It can see the room. It knows what sweater you're wearing, who you are. If there's. If Simon and I were both in the room, digital Brian would talk to both of us. It's pretty cool, right? I know this. You. You know this. But what I found, this paradigm is when there were three of us. What I mean is, if it's me and Amelia in the office at Saster and we bring up digital Jason, right? Or me and Simon bring up digital Brian, and Brian can listen to us in full duplex and participate in the conversation, then we really have this. This IRL copilot, this assistor in the real world. And it's really so, like, I can't remember everything that I've learned in 12 years. I don't know if you can. I can't remember all the thousand speakers we've had and guest posts and writers, but you know, who can. Digital Jason. When the three of us get together, it's crazy. This two IRL plus digital. So this is something that I know most people aren't building in their apps today as a core paradigm, but I think this is crazy how effective this is, because if the Digital. If I'm 100% right in my mind and Simon's in the room too, and then digital Jason's 95% right. About 12 years. Like it's. It's a superpower. This is the Mac for humans. This is. And so what I'm wondering is I'm actually shocked that we don't already have this for sales calls. For real. I'm shocked that we don't already have this for SDRs because I think by the end of the year every single sales call should not have a note taker. There's. There's probably tons in this. Every single sales call should have digital. Simon Digital. Melee digital. Jason on the sales call, clearly digital. We're not playing any games. But when I forget how the feature works, when I don't know how the assistant UI integration really works with Deepseek 3.6.4B, when I can't answer that question, Digital JSON should honestly answer it. I, I think this will utterly change how we do sales unless I'm missing something. So I, I'm shocked in fact that we don't already have this because I think we're almost, almost there. So any learnings from this is this, this paradigm. Simon.

We talked about therapy and there's probably a reason why most therapy sessions are over voice and not over text. That's just because the friction is so much lower. And so there's an effect of that where 10 times easier to say something you again unlock conversations that would not happen otherwise. And so you're basically exploring a different idea space through the lower friction. I can't. On another note, I can't. I've lost count of like the number of sales calls I've had where the person I was talking to didn't know an answer to a small technical question. Something that even seemed like obvious usually happens with larger companies that are no longer doing founder led sales. But it's like the most typical problem that you get when you try to build a sales repeatable sales motion is like you need to train your sales in place to be able to answer questions. It's so frustrating as a buyer to.

It's terrible.

Yeah. It feels like you're not really sure if the person really knows what company they're working for. So having a sort of like copilot in place which can immediately answer all sorts of questions about the product would completely solve this problem.

Yeah, I think every human interaction in business that is on the Internet at least should have a digital human, a digital person with it that knows all the answers. Every single one. Every single one. I don't. I, in fact, in fact I'm shocked now that I've done this with our own AI and I've seen how good it can be if it's trained. I'm shocked this hasn't already happened. Right. There's so many. We're. We've totally changed so many parts of software already with AI. I am shocked that every sales tool doesn't already have this functionality and that it's not pretty good because Brian and I, Brian Haligan, me and somebody else together, we're going to close the deal. Right. There's crummy like sales solution engineer tools that are like wiki on steroids. There's nothing wrong with them. But anyhow, if guys are folks are thinking and you have any like human like Internet component, I, I think your app will be better with this. They won't get nothing wrong. Everyone should bring digital Simon to the meeting. This was, this is my aha moment. Right. Okay, this next one, you talked about how therapy folks prefer voice. Right. This is just a little bit of data, but I thought this was interesting. A lot of folks on social media talk about how the future is all voice with AI. I, I'm, I've, you know, I, I was the first investor in Talk Desk, which is worth 10 billion that was redoing voice for the contact center. I've done chat. I like, I get it. I've been passionate about voice. I'm passionate. But I think we, we might also be in a VC overhype frenzy where there's a different medium for a different use case. Right. So this is just what we learned for Saster over a couple weeks. But if you look at it, web was 2000, voice was 500 and then embed which is, which is, which is really just chat. But on our homepage is 2500. So that's only 20% voice, 80% typing on a keyboard. It's something to bear in mind if you think again, customers are very different. Right. I've invested in, you know, one of my fastest growing investments is owner for restaurants. No, no one in owner is like is is on the web all day. Like they're, they're in the restaurants. You better, you better either get them through text or voice because. But, but I think this is telling how people want to interface with AI today. What have you learned? Simon? I know you're adding more, more, more paradigms to your framework, but what have you learned on this? Voice versus chat versus et cetera.

Because I'm a developer tool, developers can add more paradigms than I even anticipated. So I have a voice mode and a text. Ben. What I've also seen implemented is this sort of like unidirectional voice mode where the input is via voice, but the output of the AI agent is via text and interactive elements. And that also seems somewhat promising. I do wonder whether the friction around people using voice is mostly around us not being familiar with it because when I talk to humans, most of the time I use voice. I don't text them, especially if they're in the same room. But with a computer, we seem to prefer to type instead of using our voice to talk to them. And I do wonder whether it's just a habit thing or whether there's any actual benefit to text. Text lets you think harder about what you say and be more explicit and think more deeply in some ways. So again, I think both paradigms make sense, but I'm not sure if like the, the ratio that we see right now is going to. Is. Is the optimal one or whether we are going to shift to a world where we mostly talk to our computers.

Yeah, I don't know either. I think, I just think this data is interesting for this type of use case learning, right? That it's that voice matters, right? This is a, this is a, a multi multimedia, multi paradigm, right? Multimodal. Right? Voice matters. Take it seriously. But right now, today, despite all this talk on the Internet for, for this use case, chat is chat's 8020. So you got to be multimodal. But I just, I, I think it's a reminder to, to not ne. Like get. Believe in the hype, but get data. Get data. Maybe this will change in 12 months or 24 months. I don't know. I'm just not jumping on the bandwagon that because of a bunch of vc say it. It's true. I just think in the real world we may find that people like to chat and text, right? And in the real world we are perhaps sadly talking. We're meeting less, we're talking, we're picking up the phone less often, right? You and I are much more likely to DM than we are to pick up the phone. I just, just don't go all in on voice and be multimodal because you need to need it. All I think is, is the learning. Okay, this next one, I mean if you're deep in AI like Simon, this won't surprise you or these next ones, but to me it is 1, 1, 1 pretty smart person made fun of our AI says can't you do it just on chatgpt because chat GPT is ingested all saster content, right? Chat GPT is steal. I mean uses YouTube. Whether it steals or not, it's a different question. It certainly can crawl all of our blog, right? It's crawling every blog multiple times a day, right. If you look at the data, right. It certainly ingests Twitter data, right? I believe I Don't believe it's blocked in any way. So 99% of saster content is in chat GPT and Claude right? In deep seq. It's there somewhere. Right. And so I was skeptical of our AI and I got to tell you, it's like 50 times better than, than ChatGPT or Claude. Right. And so I had Claude, you know, write up and I don't know why, but how do I hire a great VP of sales? This is one of the classic masterpieces of content. I mean it's just. And from Jason Lemkin now I could iterate this, I could evolve my prompt, I could be nerdy, but this isn't very good. This is so generic. It's correct. The answer is good. Like it's fine. The answers that our air gives are 50 times better than this, 50 times better than this. And so I don't know that I have all the answers to why, but I think my meta learning is no, chat can't just do it no matter what anybody says. Not, not just do it. It's not the same, it's not the same relationships. There's more hallucinations and it's just not the same connection. It doesn't feel like talking to a digital Jason or digital Sasser doesn't feel like it at all. So that's my meta learning is you can't telling folks to just do it all in chat. GBT is. I, I don't know. Today it's the, it's, it's, it's, it's not the same. It can be much, I guess it can be much better, right, if you match the interface and the training to it, even if all the information's on the Internet. So any learnings on that? Simon.

Open a ChatGPT has the GPTs which you can like can like add custom data to them as well and change the system prompt. The hard part about this is like the data ingestion, that's like, I think where Delphi really shines and that's quite missing in ChatGPT's GPTs. And there's another note here which is like people like you, Jason, probably are interested in building a relationship with their users and there's no way for you to do that over ChatGPT. So you're way less likely to invest the time and energy to actually import all your data in a ChatGPT GPT to give it to everyone. Whereas on Delphi you own the customer relationship in a way. So if you at some point in the future want to Use your audience and the relationship they've built with your bot in a way to better understand your users and also directly reach out to them. You can, but on ChatGPT you really can't. There's no data you get. And for sure, one of the friction points that I've seen are a lot of times people use my SSC UI as a way to get GPT, but then embedded ChatGPT is GPT but embedded in their own website. And the main benefit they see from this is that it's now, they now own the customer relationship.

Yeah. At a business level or application level, using Assistant ui to embed ChatGPT on your own site, owning the data, owning the output, that's, that's. You should do that instantly. Right? That's much, much better. Right. I guess my, my. The bigger point I was trying to make, that shocked me. It was not just that you should not, you should not send your customers to Chat gp. At a minimum, you should, you should use something like Assistant UI to have it yourself so you have access to all the learnings and data, like 110,000%. There's a different paradigm which we wondered, we wondered this, like in the early days of Jasper for marketing emails for AI. It's like, why do I like. I wondered because I didn't know what our AI would look like in practice. I wondered, is it going to be any better than chatgpt or can I just go to chatgpt and access Saster content? Here's the part that shocked me. Because the Saster content is ingested by OpenAI and Claude. It is there. All of it's there, isn't it? Much more. All of it's there. And so I was wondering, how much better can our AI be be than what's there? It's like 50 times better. And I still don't totally understand all the whys. Right. I get we could run our own GPT and do essentially what's being done here, which is uploaded into, through the API. But forget about that, just out of the box. I thought with the fresh perspective today, Claude and Chat GPT will be closer to this AI, since it's, since it has access to all of it, but it isn't, it's not remotely as good as this AI. Right. This is an incentive to really roll your own and go deep because it's not as good. If you could learn all this from ChatGPT, you don't, you don't need our AI. Right. So I'm not sure I understand why completely but it's true. Like it's much better than the same question into Claude or chat gb. Even though they have the data.

They have too much data.

Well, they certainly have too much data. Right? That, that. But, but, but, and listen, there's, there's probably an element here. I don't know how the models are using. So does Delphi because Delphi is taking this, right? And they're putting it through the API and they are, they're, they're combining this with data from, from the models, right? So I don't, I don't think it's just they have too much. But maybe it is, maybe it is that simple, right? Maybe it is that simple. But what I can tell you is it's much better. So at a minimum like roll your own with, with, with, with assistant ui but even better go further with the data because it could be 10 times 50 times better. Even if your information's already public. It can be. I didn't expect, I didn't expect that the, the gap. It would be so much better than asking the same questions about SAS store content there. Okay. Point 7. This was super interesting to me. There's a lot of talk about AI SDRs, about outbound, right. Some controversy. I've evolved my thinking. I was a skeptic a little While ago on ASDRS because all I want, you know, getting 10 million more slightly better automated cadences I don't think is high ROI time has gone on now I really see them more as tools for humans. Going to Simon's point. I think they're very powerful. So I'm an AI SDR fan. But this is slightly different. This is a bdr. This is how well out of the box with. With not being a. With not being a verticalized tool, being a horizontal tool. Can Saster's AI answer a customer question? And this is just a learning for me. I gave it a B plus like with. This is not a sales tool. Okay. This is not trained for it. But here's a question on the right. How can I exhibit at Saster Annual 2025 didn't have to wait a day to get back to. To you like it can happen with our tiny sales team sometimes didn't have to be during normal business hours. Gave a pretty good question. Here's the sponsorship offerings from diamond to silver. How does the expo hall work? Who if you want to talk to a human. What's the right email address? This is correct. It's nearly full. This is true. What. What are the dynamics like 10,000 in person dynamics 80% from 2 million. This is all correct. And going to Simon's point, if we hired some random BDR tomorrow to qualify it, they would get most of this wrong, at least their first few weeks. They wouldn't read the perspectives, they wouldn't read the website, they give the wrong answers. These are all correct. So are all. Have all the sales type questions been perfect? No, but I'm going to give it a B plus out of the box. Out of the box. It really. It was my, it was just my learning. I did not expect out of the box it would be this good. It's literally just reading our prospectus right in the websites and a few documents. It's not. This is not the greatest accomplishment in the history of AI. This is not redoing Private Ryan in real time. But this was, this was an aha moment for it. Like this is already B BDR it's already a B BDR So if nothing else, add something like this to your product because if it can be a B BDR for us, it could be for one for you too. Right? And any. Are you surprised, Simon? Or is this what you'd expect?

It's what I expect and I'm. And I think very interesting point is that people will end up using a chat for more use cases than you initially.

Yeah, that's. That's part of it. Right.

Well, almost always converges to your AI chat needs to handle everything from support to product questions to sales questions. And it's really hard to make your users not ask the wrong type of questions in one AI chat and to direct them between different AI chats. What I've seen almost everyone do is build everything in one AI chat and teach it to do everything from sales to support to answering product questions and everything in between.

Yeah, you're right. We're, you know, we're seeing this in. In the extreme in E commerce where support, sales and marketing are already one interface. Like already. Right. Going to you. But another way to flip around is if you have a good AI, customers are going to expect to do everything. Sales, marketing, support, research. Right? Everything. And it is, it's. It raises the bar, right. But it's also very, it's very powerful. Right. But it's something you quickly see this. You're right. This is the point, folks. Quickly, if it's any good, if it's actually good, folks will use your AI very quickly for things you didn't expect it to use. Right? And they'll use it for everything. They'll use it. They'll use it for everything. Right? This, that's so powerful. Because you might think of it as a bit of an enhancement, right? Or to automate some of what you do. Like, we're thinking about the. From an automation or efficiency perspective. But it's not just automating 40% of trouble tickets. It's all the things people will want to do with your AI that they would never do without it, right. That they think to do it. So it's pretty cool. Okay, maybe just a couple last points here that surprise. These are just my surprises. They might not be surprises to some of you or to Simon. I'm surprised how much people loved our AI. I didn't know. Right. I didn't know. And, you know, this one on the bottom is pretty funny. We build AI, so I shouldn't be shocked, but I'm shocked how good this digital Jason digital AI is, even though he knows how it all works, right? And you know, I mean, I've. I've had a few conversations with wicked smart engineers that at first kind of make fun of how good I think this is, right? And they tell me how it all works and how I'm not really understanding Transformers and the future of this and that. And I'm like, okay, slow down. Just like, be a normal human and like, ask your Saster question, right? I just raised $4 million at demo day, but I've only got two people at the team. I'm growing like a rocket ship. But I. I have this competition. What should I do with my startup? I bet the answer is pretty good. I bet it's pretty good. So I was just shocked that people love this AI. They love it. Love, like really smart people. They come like. It's hard. There's some limitations to this. I'm realizing I didn't put in this one. Interesting learning is how many folks want to go anonymous. So we don't know exactly how many folks come back, right? We don't know how many unique sessions there are, but a lot of folks come back again and again to this AI, which is the ultimate test, right? If people. If people come back. And my learning is if you do this well, Simon, you kind of teased on this in the last point, but it really can, if you do it well, it really can connect you with your customers and users in a way you can't. It can add scalability to your relationships with your community, right? Your community of buyers, of prospects, of users, if it's great, right? That's the learning. People love it. Right? So I don't know anything to add to this, Simon?

There's this potential to give people magic moments that like the weather surprise and didn't expect the AI to be this good.

Yes.

And it doesn't really happen. Magic moments don't really happen anymore with like traditional B2B SaaS dashboards.

I haven't can't think of one since Canva that was pre AI. Yeah, I can't think of a magic moment. Yeah.

But they do with AI chatbots and that's really cool. And it's like probably just a novelty effect. At some point we'll get used to computers being just as good as humans and it'll be normal. But for the time being, it's a really cool way to get people to use your product. But I think it's super cool is the fact that people build different kinds of relationships. It's not like, yeah, it leads to higher conversion rates and makes everything that you already do a bit better. Perhaps. But it also unlocks new use cases, new new customer product for new in new ways, interacting with your content in new ways that like, wasn't even possible before and.

Absolutely, absolutely.

That's also really cool.

Yeah. Yeah. I just didn't know people would love it. Right. So if you can, I think it's. That's the learning and maybe you bring up a good challenge at least today. At least today. Even if you're slightly skeptical of what AI can do for your product. Flip it around. Is there something magical you can do with for it? Like start using it? Trying it in your pipe is a magical moment that you can make happen today. Right. With it. Then it's worth it, right? It's worth it. Okay, this next one. This is a meta issue. I've written about this a lot in SAS because I have pretty different views than a lot of folks on social media here. It's not my perspective, it's just what I'm observing, which is that this stuff's a good deal. So, you know, the, the craziest ones, I think. I mean, all this stuff's such a good deal. So if I look at what we're using, Delphi 29 bucks to 99 bucks a month. I mean, considering not only is it a great like, okay, if we thought about it as a chat tool, is it a good deal for a chat? It's probably mediocre, right? It's mediocre. It's fine. Right. But look at all the. All we talked about, the 6,000 additional interactions we've had. Right? The happiness, the surprise and Delight the, the talking on video with me and Brian Halligan. I mean this is crazy stuff, right? What you get for your dollar. And you know the ones I, the bigger ones. When I think of that, listen, what you can get, there are rate limits. But when you look at what you get for like Cursor and Windsurf in software development for 20 bucks a month, it's insane. It's insane. Now you can't, not everyone can get away with 20 bucks a month. If you're a full time developer doing a lot of coding, I don't think you can get away with 20 bucks a month. But. But if you're only doing a little bit and Cursor or Windsurf can write half Your code for 20 bucks and you're like social media app is $60 a month to do three schedule three tweets. It's a terrible deal. It's a terrible deal. And also all of these like Opus Clip where I invested that it's like the number one way to create social media clips from video. Like the free version is so good and it's so cheap I don't even know what I pay. Like it doesn't matter, right? It's not the first time this has happened. I think apps like Canva and others are. And Slack in the day was incredibly cheap, right? Zoom Zoom was incredibly cheap. But man, this stuff's almost too good of a deal. And I guess this is just a reminder and I know I don't know what all the costs are under the hood for everybody. I know from a few folks that I've invested in. I know that you can make the math work. I know a lot of folks are skeptical that Cursor and Wind Surf aren't just huge rappers on. On. On, you know, on Anthropic and Gemini and losing money. Right? Maybe. Right. I know Opus doesn't lose money on. On its video rendering, but I, I do think this was reminder that just be aware that you have to provide much more value going forward in your app than you did a year ago. Much more value. People are expecting more. They're expecting when instead of your chat. Just like being here when you can develop relationships with humans and it knows 12 years of data and it follows up and it's a bdr. People like you, you, your app has to be like so much better than last year is. Is just my reminder and I don't know that you can charge 50 bucks a more a month for Zendesk charges $50 extra a month for its AI. Okay. Fresh decks, fresh desk is more than twice as much to add its agent. Are we really going to be able to get away with this forever when this is 30 bucks or cursors, 20 bucks? Like, I, I don't know. I'm skeptical. I'm skeptical that we're going to be able to, to. To charge like we hope we can charge in B2B for this AI. We have been trained that everything is incredibly high value. So I don't know if you have any learnings on this one, Simon, but it's just a reminder to how. What good value these tools are. They're like insane value.

I think, I think it touched on the point that probably every SaaS app going forward is going to have an AI and well, every SaaS app going forward is probably going to be agentic and it's going to do more for you.

Yeah.

So we're entering a new era where these apps don't just let you manage data and present it in a better way, but also get things done for you by just accepting natural language instructions. That's like the era of SaaS apps that we're going into where it's like agentic SaaS apps, vertical AI agents doing things for you. And it's. I think it's important to start early on to like build, build the right data set to be able to support these use cases. Yeah, I think it's. I think it's really good to jump on the trend and add some sort of AI interface in your app to some sort of natural language interface in your app to see what sort of questions people ask and also train your users to use more agent patterns.

Yes.

And like grow with that because these things take a while to build. It takes a while to get to product market fit because it's almost a new product. And I definitely think that the user expectations of like what sort of value you get for software is going to change. We're now suddenly able to make a lot more work with software and so the typical software that you pay for is going to do a lot more for you. And to your point, I think it's definitely going to be deflationary in the sense that like, for the amount of value provided, where the expectations are going to change since computers can so much do much more than they used to.

Right. Yeah. I just think maybe to pick on that and then we'll go to the last point for time. I guess my challenge to anybody watching or listening or thinking is just for don't view. Maybe, maybe it was okay last Year, I don't know if it was. But today, don't view AI as an upsell. Don't view it as something you're going to charge extra for. View it as, how can I make my product 10x part of my product 10x better? And how can I do that today? Because the competition is going to be doing it right. It makes. If your product is not better because of AI, it's going to look like more and more of a ripoff. More and more of a ripoff. And if you squint at a lot of public SaaS companies, they're not adding any net new customers anymore. They're flat pager duty, no net new customers. Okay? It's happening again and again. And listen, if you keep, if, if you view AI as a feature to charge more for, you will get more money from your customers because they're already customers. They'll try it. If they, if they trust you or they even like you, they'll try it. They'll pay you the money. But that's. Don't view it as an upsell. View it as core to your product going forward. Rethink it. And that's, I think, the future. And if you get your sales team and your market team, your product together and all they're talking about is upsell for AI, I think the competition is going to kill you. I think they're going to kill you because they're going to do ten times as much for the same dollar or less. Okay, last point and then we'll run out of time. We can do another session with Simon later and if you guys want, we'll ask you and we can do a deep dive on everything he's seen across all of, all of his, all the folks on open source and otherwise at Assistant, because he has tons of data. But the last meta question I have around is, what's defensible? And again, I just, I tried this app deli, because the way we find most things brand, I saw that Lenny and Brian Halligan used it. So when I finally had a spare moment, four months went by. I had a minute. I'm like, let me try it. Okay. This is how most of us in the real world discover apps. I see it, I see someone on the Internet, Simon says a tweet that it's great. Jason says, we've run, we use rippling or gusto. And 80% of the world does not have time to like try out 82 apps. So that's how I tried it. I actually didn't know if it was the best I was. Actually, all of this is outperformed my expectations. Okay. And all of it. But then afterwards, I grabbed another app. Someone said, hey, try this. This is. This is another app that can ingest all your data, create a chatbot and do the same thing. I'm like, well, that's interesting. I'll just try it to learn. I'm not going to move. But it has an RSS feed, It has scraping, it has all this. It just didn't work. It just didn't work. Okay. It just gave me generic cloud like answers. So that's today. And I think it's a reminder that the product matters more than not only the tool underneath, but probably the model. But at the same time, all of this is public. Anyone should be able to build a clone of this AI, right? In fact, anyone could fire up the same application, attach the same feeds, and outside of the personal training I've done, which isn't much, is reproduce it. So I don't know what's defensible here. I don't know what is any metal. This is. I just learning. I know a lot now that I know one point. Now I know less about defensibility because I'm realizing as amazing as our AI is jaw dropping like, it's really great. You could build your own in a week and it would be just as good because 99% of this is on the Internet. You have to put in the work, right? But you could clone it in a week. So that's the one I'm still processing the learnings from. As great as it is, someone smart could build this in a week and possibly an hour.

I think that's true for most B2B SaaS apps that you could probably.

No, you cannot build Workday or Salesforce in an hour. No matter what anybody says. You cannot fire up Lovable and build Salesforce an hour. You cannot.

There's probably a couple of B2B SaaS apps that are worth a billion dollars that you could build over a weekend. And it's just like to theoretically build over every. It's actually a lot more work to get all the details right and build the customer relationships and the sales motion and everything. I think the same applies here. The Same rules of B2B SaaS continue working here. AI itself is not going to be defensible. Just the technology.

That's the thing. The AI itself is not defensible. Right.

What I would recommend you do if you implement AI is to not see AI as an R and D thing, but rather you're just using what's off the shelf available to you and just building a good product around it. And I think that's a much better way to view AI than to say you're building your own AI models and doing everything in house.

Yeah, none of that is defensible. I mean, we know it's not defensible, but now that I've seen it in our AI, I'm triply convinced it's not defensible. Right, yeah.

Yeah. So AI is just another feature in your SO wrapping.

I know we're at time. Do you, do you then, given all of that, given what we've learned about the defensibility here, do you think that plays to the strength of folks that have the massive data sets to the hubspots, to the salesforce, to the workdays, to the folks where people have already are already investing in investing data on thousands and thousands of interactions of humans? There's a lot of discussion on who benefits. Right now the answer seems to be both startups and the big guys. Right. But any meta learnings from this on defensibility? Is this the renaissance of HubSpot and Salesforce and Workday?

No, I don't think so. So, like, maybe temporarily, but the amount of data you need for to train AI is going down. It's converging as a general models become even better. So the total sum of data you need to create a really good AI agent is going down. And that's kind of democratizing. That means that everyone can build really.

Good AI agents and it means you might have 10 times more competitors than you had last year. That's the other thing I'm seeing a lot.

Right, that's true as well.

All right, thank you everybody. I know we're at the hour slightly past. Amelia, thank you for guiding us. Simon, thank you for joining us. If you guys want to do more of a deep dive with Simon, ask how things really work. We're going to do more stuff like this. And again, about half our content at Sastra Annual in May is at the intersection of AI and B2B, where we'll dig into all this kind of stuff. So see everybody next week. We're gonna have Chemistry Ventures, talk about Series A funding, and then again, see everybody in May 1st Astra Annual. Thanks you guys.