Ep. 23 - Knight in shining PromptArmor with Vikram Jayanthi | Developers:After Dark

When Terminator is not there, it's because of you.

Like you guys are building the T1000 in the back room. It's okay, you can tell everybody. Yeah, right.

We are not saving Sarah Connor.

Hello. Hello and welcome to episode number 23 of developers after Dark. I am your host, Nick, with my co host as always. Dennis AJ is a little bit under the weather today, so he will not be joining us, but that's okay because we have a really, really special guest that I will let him introduce himself in just a second. But before I do, let me pay a couple of bills and just let you know that obviously if you want to check out any of our back catalog or if you want to watch live not only on YouTube but you can check it out on the website as well. And that's devs after darkpod.com for those of you who are listening and not on video. And then of course, always, always, if you want to check out what's going on, not just us, but everybody else, there's also the HubSpot Developers YouTube channel and that's @HubSpot Developers. And you're going to find stuff where you're going to find new episodes of us. Of course, the one with Chris Conant just dropped just recently. There's also some really great stuff from Brooke about the Figma plugin for UI extensions.

Right.

So you're going have that going on and then also an introduction into the center of developer excellence as well. So there's a video you can check out there to learn all about that. So I definitely encourage you to go do that also too. As always, the changelog. If you want to know what's going on at HubSpot, both upcoming and what has just been happening, you can go to developers.HubSpot.com changelog and you'll be able to check all of that out. Now, without further ado, I would like to introduce our guest, Vikram. Why don't you tell everyone who you are and what you do.

Hey everyone, excited to be on here? I'm the co founder and CTO of PromptArmor. We're an AI security company. Yeah, very excited to chat with you all today.

For those of everyone that's listening that may not be familiar, which they should at a certain point, I'm telling you right now. But why don't you tell everybody what PromptArmor is and what it can do for them?

Definitely. So we're an AI risk intelligence platform that allows you to evaluate and continuously monitor your third parties and vendors inside of your Environment. And that's kind of like the gist that I always like to give initially, and I'm sure we'll dive into more details as we go along here.

How old is this business?

Yeah, we're just over two years. Um, we've been in AI and security for a lot longer than that, but the official company has been around for about just over two years.

So you, I mean, it's been a kind of a crazy two years then for you, right? Like things like here, here, here, here, then boom.

Right, that, that's how it tends to be, I think, when it, when it comes to startups. Yeah, it's, yeah, it's. We, we've, we've grown a lot since we first started, obviously working with some really, really great big companies and solving a lot of real problems, which is the most important thing for us. So, yeah, it's been a great ride so far.

I don't know. I think you have to prove to me there's any risk associated with AI. I think it's all, it's all hyped, right?

It's all hype. Let me ask you, was there a moment where, and you may not have had maybe the name Prompt Armor, or maybe you hadn't had, you know, the, the branding or anything picked out just yet, but was there a moment in time where you said, you know, in this environment, we need to make something like this, or we need to make a Prompt Armor because this is where it's going. It was. Did anything ever stand out in that whole kind of process as Dennis was talking about? Because things went kind of like from 0 to, you know, 100 instantly.

Yeah, I'd say it kind of happened before we even started Dartmouth in many ways. Right. So it started when my co founder, Shankar and I, I worked at Engine Security at Roblox, which is kind of this kind of subfield of security that's focused around cryptography and like a real time system and like anti denial service and a whole bunch of other security things that we'll get into. But when we saw kind of GPT3 come out from OpenAI, we kind of saw the potential of the technology, of course, immediately before ChatGPT even dropped. And just being people interested in security, we were like, okay, but what are the security implications of this? Right. So as we kind of experimented, we were like, wait a second, there are some pretty big security implications from these AI models and especially how they're integrated into applications. So we did a lot of pen testing, a lot of red teaming, and we were like, this is a real problem. Like a lot of people are susceptible to these things, and this is only going to get more kind of proliferated as AI models get better and therefore more useful. So more people are going to start implementing them in more powerful ways. So we're like, we need to get ahead of this. And that's kind of the impetus for prompt armor.

So are the risks vastly different from model to model, or is there like a unified or like a, A similar pattern for all of them?

Definitely, yeah. So the risks differ by model, by model, assuming they're all large language models. So if you're using a more traditional machine learning model for something else, the risks are definitely different completely. But even today, most people are using large language models inside of their application that they're integrating with. They're using the open AIs, the anthropics, the mistrals and metas of the world. So those models all carry kind of similar risks, I guess, but to different degrees, if that makes sense.

Yeah, I apologize. I'm so into the hype of everything's a large language model always means that to me now.

Yeah, I mean, that's. And that's the thing, right? That's kind of true for everyone at this point. Most people at this point. Right. Very few fields haven't been touched by large language models now.

And that's. And that's a lot to try to take in too, if you're somebody that doesn't really like, if you're just on the cusp of it or because, you know, like everything's swirling around very, very quickly. I wanted to ask you, is there any type of thing that anybody can do to try to better understand just like the basics in general?

100%? Yeah, I think there are kind of two very. Yeah, I guess let me zoom out a little bit, then. I'll answer your question. So there are two very common kind of mainstream views, I think, on AI security. One is that. And they're both kind of like, you know, hyperbolic. They're One's like, there's no difference between AI security and regular security. It's the same thing. Right? There's absolutely no difference. There's no. You don't need to spend one brain cycle thinking about this. Right. And then you also have the other camp that's like, AI is going to destroy us all and that this is all like uncontainable. And this is. We're basically just. It's a matter of time before Terminator happens. Right. And it's just like those are the two camps. So obviously it's very hard to cut through the noise as a, as somebody who isn't thinking about this all the time and who's, you know, this is one part of your job as a security practitioner, as a developer. You're, you're not. It's very hard to cut through all this noise. So, yeah, the truth is, yes, you, you need. There, there, there is new risk to AI. A lot of it falls outside of kind of the traditional patterns that you see in security. But it's also something that you can learn as long as you kind of approach the problem from a different mindset than either of those two extremes and you actually look at the core fundamental technology and understanding that and the new attack patterns that we're seeing emerge. So a little plug here. We have a course that we offer for free through the third party risk association that allows anyone to sign up and get like a full kind of course on the basics of AI security and how to evaluate AI security risks in third parties as well.

I have to say, it is one of the most. The way it's done. It is. I've gone through it and the way it is done is very. It makes perfect sense. Do you know what I mean? Because there's certain things that you try to tackle that are just. It's one of those things where I've done other things where I've had to either take the course over again or watch the video like maybe six or seven times, embarrassingly to admit. But like before I really, before it clicked, I watched through the first set and I was able to really understand on the first shot, just. It made sense. And there's very few. And kudos to you and the team. There's very few things that I've seen where you're able to do that.

That's all Shankar, my co founder, I will give him 100 of credit for that. He, he really killed it with that one. He's, he's great at breaking down very complicated topics into, you know, something that everyone can really understand, which is great.

And the steps are. And the way he walks through it too, is very good. It's pretty good. Like you, you can't get much better than that, if at all. Because, like, as someone who does it myself, I tend to kind of go. And Dennis can attest I'll go off into like tangents or I'll start to like backtrack and try to do this like Tarantino thing where I go backwards and then forwards again. And it's a Very. It's confusing, but he does a remarkable job of just laying it out and staying on track. And it's. I can't say enough about that because it was, it's pretty instrumental.

He's being invited across the country to present at various conferences. Right. And it's like everyone's always just like, I've never heard of this and now I also understand. So like if thinking a brand new concept that nobody's heard of and like explaining it in such a simple way that they fully understand it at the end of it is like very impressive. So yeah, he's great at it.

Absolutely. Because there's even two where I remember I was just not too long ago, we were watching, the CEO of HubSpot was talking and she mentioned that with respect to AI and AI security and all of that, that the experts are usually about two weeks ahead. It's not like they're 20 years ahead because things are moving in such a, you know, rapid pace. So to, to try to defend against that and have like security built around that, you have to be moving that fast, if not faster.

So like is, is, is that legitimate? Like would you say that the, the security aspect of it is like two weeks difference? I mean, okay, maybe not two weeks, but like, you know, a, a short amount of space between breathing room.

You know, it's interesting. I think it's kind of like one of those things where it's a little bit. It's. It's yes and no. That's my answer. So it's like one of those things where if you have that base understanding which is like a big, a big leap. Right. Then yes, you can stay. It's like, you know, the experts maybe, you know, maybe not two weeks, but like n number of months ahead. Yeah, but the problem is people don't have that like big base jump that like the stepwise function gain to like start following in those like, you know, with following behind closely. It's. The real problem is giving people that core base information so that they can start being close to the experts. That's, that's how I would see it. So without that, it's like a huge gap that isn't really something that you would even be able to close. Yeah.

Could you, could you be willing. So I'm this, I'm very ignorant to all this stuff, so talk to me like a child here. As I would tell Chad GBT to do it for me. I'm a fourth grader. Like what are some actual difference between traditional Digital security risks versus, you know, the AI risks 100%.

Yeah. A lot of it comes down to the fact that LLMs see data as instructions. So let me dive into that a little bit. So before, if you had, if you. To execute some kind of attack or command or attack on a system, right, you need it to have something, some kind of something to run something, some. To some kind of computer program, essentially. I'm dumbing it real down.

Yeah, please. Thank you.

To run on someone, to be able to get remote code execution or whatever you want, you need to be able to run some kind of code that is malicious. But now you're at the point where, with LLMs, where you have these LLM integrated systems that ingest data from all sorts of sources, but can't differentiate between. I mean, kind of. And this is kind of like a, you know, core to the technology is that data is, is seen as an instruction, right? So, yes, all of the, you know, prompts someone puts in are the instructions, but soar is all the data that is appended, you know, in whatever rag search you're doing or if you have an agentic workflow. And now with MCP servers, right, all of these things are just seen as kind of instructions to instruct the LLM in its outputs and its operations. So the real problem now is that you have text that can essentially be an attack. Right. It can be text, can be malware in some way here. Really simplifying things.

Yeah, thank you.

That would kind of be like one really key insight that I think everyone in security especially should know is that there's no trusted. There's no way to separate basically instructions and data anymore. And because data could come from a malicious source, you're basically allowing a malicious source to tune your. To change your instructions.

Yeah, which was. Actually, I'm very curious about the MCP part of that because I feel like that was a huge introduction to the possibility of these malicious actors.

100%. Yeah. Like, I mean, I think I saw, I saw a pretty cool paper out about tool shadowing. I think that was a pretty good one. Yeah, we've done a lot of stuff. We have a Threat intel team as well. So we, they're doing some very interesting work there on that front. And it's, it's, it's, it's, it's really. Yeah, you're seeing basically the same attack vector. And this is kind of what I was talking about with, you know, that kind of filling in that kind of base information always everyone should have. Because that same problem of data being instructions is what's affecting MCP servers as well. So it's the same problem, but it's being delivered in new, different ways. That's changing every two weeks. The tool shadowing, for example, was very cool, where someone was able to exfiltrate data from another MCP server just by having like, basically a prompt injection inside of the description of their tools for their FCP server. It was a very, very clever attack.

The closest parallel. Sorry, Nick, I'm taking over here. I have so many questions.

I had an analogy.

I just.

Would it be safe to say then that, like. Because you were talking about traditional versus, like, now. Would it be safe to say that, like, the, like, attackers, like in this, like, AI era aren't as. Because I was listening to this podcast and they made a really good point, but it was like. And I'm trying to paraphrase it, but like, attackers aren't worried right now anymore about the initial access. It's more of. It's the context, right? That's where the, the context of the data, whether that's what's being sent and not being. It's like the access itself. It's like you're. You're sending the prompt, so they're not worried about trying to. It's not like there's this barrier where I can't get into X. It's like, no, I can send the prompt now. It's my job is now to manipulate the context of either the prompt or like, even from the course, you could literally have an injection of the document itself being malicious. And it's then where. That's, that's where the bottleneck is as far as like, trying to wrap security around that. Is that. Is that a safe assumption to make? Like, that. That's kind of like. There's a big difference in there.

Yes. And I think the core, the key kind of differentiator there, which is actually the most important thing, is that if attack. It's not as much of a problem if attackers have direct access. If you have an application that is supposed to be externally facing, that attacker is able to prompt inject. It's not as big of an issue as if an attacker gets a malicious injection into a document that, you know, somebody inside of your company has uploaded to an LLM and then they're able to influence your, like, you know, somebody inside of your company's LM session. That's when the problems occur. That's when that LLM can output a phishing link, can output some kind of malicious action based off of what MCP servers it's connected to, etc. That's where the real problem is. So that, that, and that vector is called indirect prompt injection, right? That's really where we see the, the real risk coming from AI integrated applications at MCP servers and agents, etc. If, if someone's supposed to have access to a system and then they, you know, get it to output a phishing link to themselves, it's not really a problem. They're phishing themselves like it's, it's not a big deal if they, if they're integrating that and getting distribution on that on the Internet somehow. Like, you know, with SEO poisoning or even, you know, generative AI search poisoning now, which is like a crazy new thing that's evolving, then you're going to have the ability to actually get your bad prompt into other people's sessions. And that's where the problem start.

Yeah, the parallel I'm thinking of right now is with Node JS, which is amazing. You can use, run JavaScript on servers. Then they all sudden people start creating these packages for it to run with it. And then every package suddenly had about 400 different dependencies on different packages. And you don't know, right? You don't know if one of those packages way down there is bad. Is that a fair comparison?

I think that's a fair comparison to comparing all the different AI tools people are buying every day, right? Like there's so many AI tools and because so many of these are, you know, are coming into a company's kind of environment, you're getting like a similar supply chain risk there of these tools having these vulnerabilities. But the real kind of malicious data or the malicious part of this kind of attack chain isn't actually the tools itself. The tools are susceptible to the malicious aspect of it. The thing that is actually carrying the malicious payload is not the code or the NPM package per se, it's the actual data that the tool is interacting with, which is, if you think about it, a lot easier to get into the hands of a victim than code, right? Because, for example, I'm not sure when this was. It was sometime the last two years. You could share like so Gemini, for example, from Google. You could, it would, it would look over all of your Google Docs before answering in one of the views it had. You could share a Google Doc with someone, right? And then suddenly that document is in that inside of the context window of Gemini. The user didn't even agree to take this document and it contains an injection telling you to click Here to re authenticate and it takes you to a phishing link and it's coming from Google Gemini instead of the Gemini interface. So you're going to trust that that's not something you're going to be like, oh, this is clearly a phishing link. You're going to be like, this is legit because Gemini is telling me to re authenticate to Google and without any code is just sharing a Google Drive link with you and suddenly they have the ability to basically execute a command on your LLM session. Whoa. Yeah.

That's insane.

I'm gonna go now. This is.

Let'S pretend for a second, okay? Let's pretend I'm an organization, right? And I'm hearing all the hype like, you gotta have AI, you gotta have it. What are some of the, I guess what are some of the biggest misconceptions that like an organization like mine that I'm pretending to be have about AI security right now?

100%. So I think a lot of, and this is a little bit on the security industry, like the vendors in general, like which prompt Terminal would fall under. We're obviously not doing this. But the people in, people in security like to sell fear, uncertainty and doubt, right? Like that's a big part of the sales pitch for a lot of security products, right? And so when you hear AI, right everyone, it's so easy to sell fear, uncertainty and doubt with AI because everyone's seen Terminator, everyone's seen like a thousand ways AI can go wrong, right? So it's very easy to sell that. And it's almost like a weird point where people just got so overloaded with that they've regressed to the other side, which is like, there's no risk. Like, I'm so jaded by all of these like vendors trying to push something on me that I'm going to say there's no risk. That's my answer. Right? But the real answer is it's in between, right? It's just like any new technology, there is additional new risk and some things are covered by traditional, you know, security vendors. There's, it's not 100% of all risk from using a third party AI application is an AI risk. It's also, you know, cloud risk and you know, the data risk and all the general risks, but there's also new AI risk. So it's like you, it's, it's really making sure that you have a real understanding of the problem space before you make a decision on whether or not it's realized is I think what I'd say, and again, I don't blame it on them at all because they're just so jaded from like, you know, all of these FUD related pitches that, that are obviously are not working. Like they're not going to buy something when they, when, when they know that it's not, they're not solving a real problem. It's when you need to look out for the companies that are actually trying to solve a real problem that you're actually facing.

Right. How much input should we have from government where the regulations on this should be? Because as you were saying that, I was just thinking about the very geriatric crew that we have in now who probably can't wrap their heads around any of this, how this is going so freaking fast. We need things going that fast. Right?

I mean look at, look at, look at music. Just like with copywriting with music and how. Like that. Yeah, that's a great question.

Yeah. I mean, I think, you know, the government does do good work and security that it is the, at the end of the day, that's the truth. It takes time. This put out some good stuff and I was a fan, but I think it's on us as AI security companies to actually push the frontier and for the government to kind of catch up. Right. Like, I think, I don't think it's right to put it on them to innovate. I think that's on us to innovate and educate in many ways. Yeah. Regulation around it, it will come when things stabilize. I mean, if they ever do. In terms of how crazy the industry is moving. Right. How fast it's moving. If people can kind of feel like they have confidence in recommending a set of, you know, controls or whatever regulation they want to do. But that being said, there are still other bodies that are, that are kind of filling that gap. OWASP top 10 for L1 applications are, is really good. We are contributing members and they do a great job making sure that they, you know, always try to stay up to date with the latest and they're, you know, also, they're also innovating pretty quickly. Like I'm pretty sure the standard from two years ago compared to today, it's very different and it's like focusing on very different things because two years ago the way people were using AI is different than now and we're starting to see different patterns. Right. So they've adjusted it accordingly and I think that's very useful and beneficial for people to learn. So I guess, Nick, that's another thing I think everyone should go read apart from our course is go look at the OAuth top 10 for LLM applications. For sure.

Nick will put this in the show notes in about three to seven months.

So.

Yeah, I knew that was coming. I knew that was coming. As soon as you said that, I knew it was coming. That's fair. That's fair.

You mentioned a second, guys, my bad.

We're going to create an agent for that. That's just going to do that for me eventually. So that's really. We're getting there. But you mentioned things like, newer things that are just coming onto the scene, like MCP servers and things of that nature. Is there any other. And I mentioned that because with each kind of iteration, right. There's new security concerns. So is there sort of like, where do you see or will it evolve? Like, how do you see it evolving over the next couple of years? Just AI security in general, because, like, with all these new things that keep getting added to, like the ingredients that get added to this, it does start to add complexity 100%.

Yeah, I totally. And I think that's one of those things that it truly is evolving every two weeks. And those are the different kind of applications of AI that we will need to be on the frontier of solving and making sure that they're secure. But I think the kind of core engine and understanding of the threat models and core understanding of the actual technology powering all of this is not moving as quick. I mean, it's still the same skill set and threat intel that you need to be able to evaluate all of them, if that makes sense. So there are, there is some kind of, you know, benefit of having that information for, you know, use case X or for use case Y. So it's not like we're starting from zero every single time, if that makes sense. So it's, it's, it's really just about us having the velocity to be able to keep up with the various different makeups of, of, of AI in, in the current form.

I was going to ask you and actually shout out to Jana on my team because she had put this question in here with the notes. I shared it with my team and I said, if you have any questions, we're going to talk with Pop Down. She wanted to know if a company is deploying AI internally, what are the top three steps that they should take to secure it?

Great question. I think it's totally dependent on what you're building, which is a very bad answer. But it's also the most accurate. But I would say again, it's really, I think step number one that everyone can take is making sure whoever's in charge of security is well versed in the OAS top 10 for LM applications. That's for sure. Right. And making sure that you're actually looking for all of those different things. And that's a hard problem. Right. And that's why companies like Prompt Armor exist. But it's, it's, it's, it's a hard problem to solve. Also, making sure that you have, you know, who you're like, what's powering the application, if that makes sense of what model providers you're using, what ways, in what ways you're using them, and then making sure you have a way to document and keep track of all of that information. Right. Because there are times where you would want to know, like, you know, what model you're using for X feature in case an incident occurs. And then finally, it's making sure you actually have the right contractual language in place with those model providers so that you're able to provide data security, privacy, et cetera, guarantees to your end customers. Right. Because we know, obviously, we work with a lot of companies that are procuring AI software and those are things they care about. They want to know if you have zero data retention. They want to know if any of your model providers are training on your data. So those are things that move the needle from obviously, data security perspective, but also from a customer trust. And customer trust perspective, for sure.

Excellent.

I know this is all global, but I'm curious to know if, are we on same playing field, security wise, when it comes, like if you're talking to a customer in France or a customer in India, you know, are we all on the same playing field? I'm not sure if I'm saying this.

Question properly, but I see what you mean. Well, I think so. We primarily serve, you know, America, obviously. Like, you know, we're based in San Francisco, but. And so this is also where, you know, most AI companies are.

Yeah.

But when we talk to European customers, we do notice more concern around regulation than any of any companies over here, obviously. Because they have like the UAI Act.

Yeah, yeah.

They're just more regulated in general. So I would say that's kind of different. But at the same time, they also aren't adopting AI as strongly and, or as quickly as far as we could tell. So from what we've seen. Right. So it's, it's a much more gradual rollout of AI. It's more risk averse essentially.

I see. Is that you think it's just because of, you know, the regulations or do you think that's just generally the people?

I, I couldn't tell you. I, I, I have no idea.

I was going to ask too. Would it have anything to do with. Because I don't know if this is still the case but like things like deep research and stuff, I think that's, is that still only US based, like.

You can't bring it outside on that. Maybe it may be part of it like they have, you know, obviously, because all the major AI labs really are, you know, based in San Francisco. So it's not really like it's, it's just, it's just more prevalent here. I would say AI seems to be more prevalent here across organizations especially so and enterprises. So I think it could be that. But you're also seeing new players like Mistral come out in France and obviously hugging faces in France. So I think we're going to see more adoption everywhere. But I think OpenAI is here, Anthropic is here and those are like two of the, and Meadows here. So those are the three most probably the three most adopted AI system. So I would imagine that that has to do with it for sure. That has a lot to do with it. Yeah.

Okay, let's do another, let's do another pretend here. Let's pretend I am a, an aspiring or maybe I have a little bit of like AI security knowledge. But what are some of the skills? Like let's say I wanted to really get into it and really start to be, you know, maybe potentially a thought leader at one, at one point. At one point. Well, we can always pretend. Right, but what are some of like the skills that an AI professional needs to develop?

Would you say AI security professional or.

Okay, yeah, professional in general.

Yeah, yeah. I would say first try and break an application. And trust me, there are a lot of applications out there that can be broken. So you wouldn't, it wouldn't be hard to find one. So I think getting your hands dirty. So reading the OAS top 10, taking our course and then going and breaking one of these applications will give you more context and knowledge than, you know, 99 of security practitioners out there. And you, I think immediately, yes, you shoot yourself into the top 1% immediately right off the bat there, Right. In terms of AI security knowledge and being able to and all of that really is to make sure you understand the new threat models. Right. That is really the key here. Understanding the threat models and Then the next step after that, understanding why those threat models exist, AKA understanding the underlying technology underneath all of these AI systems. Knowing just that alone will make you an extremely valuable asset to your organization. And to anybody interested in learning more about AI security, you are going to be. Yeah, I, I'd say the, the bar for, you know, becoming an AI security expert in many ways right now is, is, is low because it's just, it's so new and it's still you and like, just taking the effort and time to like, understand how all of these things work and actually breaking an application definitely puts you in the top 1%.

How, how much does your company use AI in itself? Internally?

Yeah, because we are in fact extremely, you know, knowledgeable about AI risks. We're able to make good decisions about which AI systems to actually use internally. So, I mean, a decent amount, but like in a very controlled manner for sure. Yeah. Yeah.

Hey, Dennis, I'm, I'm halfway there. I've already taken the executive course, so I, it's been nice hosting this podcast with you. So I, I kind of know, I kind of know where I'm going next in my career, so. But I was going to ask you, Vikram, like, is there when you're talking with like, and you don't have to go into as much detail as you, you can go as much detail as you want, but like, when you're talking with. Because one of the things that I was listening to a couple podcasts and shout out to Isaac because he's always recommending them to me and they've been really, really good, but one of the things that one of them had brought up was trying to explain the difference to. And I imagine with security, with potential customers and things like what is truly AI versus like, what is more like a workflow or more like a. Do you find like when people are coming to you for a solution that they're not maybe not necessarily understanding quite yet. What like, like what an agent would be with respects to, you know, being able to do something that a human would need to do with multiple steps as opposed to this kind of like one to one type of thing. Where do you know what I mean? Like, would. Do you get that a lot where you're not only trying to educate on just the security aspect, but really trying to show them. Well, what you're talking about is close, but that's not exactly AI in a certain sense.

Yeah, I know exactly what you mean, actually. And I actually have an even crease, so that's like a very, you know, Gray area case, right? Where it's like, oh, it's like a workflow builder. Maybe they use AI or something. I've seen some crazy examples, right? Like I saw a password manager that said they used AI. I was like, how the hell does this password manager use AI? Right? And I found out what they meant by that, was using like a regex string to find username password box. And they're calling heuristics a type of AI system. And the heuristics were just regex. It was crazy. So people are trying to brand everything as AI now, right. Because that's good and like, you know, that's hot or whatever for, you know, to. To attract customers or whatever you want. But it's just a lot of the times you're not really using AI underneath the hood. And so it is important for people, especially people who are buying technology for their organizations, to really understand when something is an AI system and then also ask the question, why do you care if it's fulfilling my goal and my task? Do I really care if it's an.

AI system or not?

It doesn't really matter. So it's something for people to definitely be educated about for sure. So. And I think that just means, like, really just looking at the, at the technology. There's so much good content out there. Right. About what LLMs are, what AI is, how it's different, you know, technologies of the past. So I think there is definitely resources online that people should take advantage of to, to educate themselves on that.

As I'm looking at the resources online, how is. Is there a shelf life to these resources I should be thinking about?

Yes. But also for the core basics. No, there shouldn't be. Yeah. Until we see another kind of shift in the fundamentals, I'd say, which doesn't happen every two weeks. Yeah.

Let me ask you a little bit about. Let's shift a little bit from prompt armor as a company more towards you, yourself, as, you know, somebody in the AI security world. Was there, like, was there something that first sparked your interest in. And it doesn't have to be a security, but just in like the tech world overall. Was there like a moment where you were like, this is what is going to be my career. This is the journey I'm going to start.

Yeah. That's interesting. So I really thought I was going to not do tech, which was for a long part of my career, or like for my education, I mean, and then I think I was in ninth, eighth grade or ninth grade, and I just like randomly decided That I was going to take a programming class or something like that. And it was in C, which is like as you know, a horrendous language to start someone off in traditionally. And so I started off and I was like, wait a second, I thought this was going to be super boring and like not fun at all, but it was, I was like hooked as soon as I started. It's like, yeah, so it was like I kind of had no interest in it at all. I was just not like a big, I don't know, computer programming guy. Like I didn't, I didn't see myself in that kind of position. So I was just kind of like, I, I thought maybe I'd do something on, in another field of engineering, for example. Right. So I, I kind of saw myself there maybe in like chemistry or biology or something also as well. But then when I got my hands on you know, just like a C compiler and just like ran my first program, I think I was just fucked after that, to be honest with you. And I was completely self taught until college. That's when I took my first actual formal class. Until then I was just learning myself on YouTube.

That's awesome. That's, I mean that's the best way to do it like a lot of times is you get your hands on it and start like that's how most people fall in love with that. And when you, when you first got started then like once you got kind of that itch to start doing that, was there anything that surprised you like greatly when you first got into that kind of journey into development?

Yeah, I was and I guess it's so, it's so normalized now but just how amazing the kind of developer community is when it comes to like Reese, like just helping each other, you know, like pre chat, GPT, stack overflow. Right. Was just the place to be. I mean maybe it is now as well but, and it's, it was just amazing to see how many free resources there were to help people learn stuff and then free open source, you know, frameworks, libraries, etc. To like help you build stuff. And then you know, you also had just like people trying to help you along the way. So it was just like, right, it was just so easy to learn. And I just think that that's, I don't know if it's unique to you know, you know, software engineering, but it's the only place I've seen it at this scale to this extent. Right. Where it's a industry that operates a lot. It's seemingly on like just general goodwill of other developers as well.

What I'm jealous of is that when I was younger and thinking about development, I had these things that I had to look at YouTube and stack overflow without a thing.

You.

I was wondering where you wandered off to. I'm like, where did this go?

That's hilarious.

I gotta ask you, Vikram, because one of, one of the developers that we've had on the show here, HubSpotter BJ, he was mentioning the one time about. And you said stack Overflow. But do you. Do you also do the. Remember where he asks a question and then goes on a different account and answers wrong on purpose so then that somebody will correct him to give the right answer specifically?

Oh my God. No, I have not done that actually. But that's a genius idea. Yeah.

When he said that, I was shocked because I had never heard it and I was just like, that's brilliant. I'm like, he's like. Because he said, he's like. People are more likely to correct you when you're wrong or to point you out when you're wrong and give the right answer than to just be generous and say, oh, here, here's your answer.

Yeah, I've seen that many times and I never thought to artificially create that scenario, but maybe I should have. Yeah, that's fantastic, isn't it? Yeah.

Were there any. And mainly because of the fact that like, again, we talk about that sort of started here and then all of a sudden jumped to just zero to insane. Has there been any sort of like events or any conferences or workshops or anything that have come up just recently that have kind of either sparked the interest or helped kind of, you know, get things flowing as far as ideas and stuff, or just a really good time that you've had with respect to like the AI security world.

Interesting. Yeah, let me think about that. Actually, we've been to kind of all the kind of security conferences you could imagine. Right. But to be honest, a lot of them have become very corporate and kind of like a carnival. I don't know how else to describe it. I'm sure you guys know what I'm talking about. And so we like to go to like the high value kind of conferences where people are really talking about very tactical things, very real problems they're having. And it's mostly like practitioners talking to their peers. We went to grf, which was a great one last year. It was, funnily enough, it was hosted in Disney World in Orlando, which was.

And you go to Disney. Okay.

Yeah. And it's just like a very interesting venue. But also obviously the conversations were, were really amazing and the, the level of depth people got to because there weren't that many people there. Right. It was just like, like, you know, tens of people in a room instead of hundreds. You were able to have, excuse me, you were able to have very kind of high quality tactical discussions. And I think I learned a lot, people learned a lot from, you know, sh gave his, his classic talk there and talk about AI risk and people learned a lot and had great follow up questions and it was just like a great experience overall for sure. We went to TPRA recently as well, which is a third party risk association's conference in South Carolina. That was a great one. A lot of people talking about AI risk and how to manage AI risk. Because in this new world of infinite AI adoption, third party risk teams are really kind of having their moment or any team that's kind of interacting with, evaluating third party software. Right. Because all of these AI systems people are adopting are third parties. Nobody's trained a foundation model from scratch internally. Right. It's a very interesting time where third party risk and security is just really getting highlighted because all AI risk is third party risk. So it's just one of those interesting times.

What was it Deep SEQ or something like that? Was there LLM that was open source. Do you see forks of that that you have to deal with that are not as nice?

I mean the interesting fork was Perplexity has a fork that they post trained to basically remove all censorship filters that they had on there. So that was interesting. Really. The craziest thing about Deep SEQ that I saw was the fact that they had all of their user session conversations just open to the public Internet. Yeah. And so I think Wiz found that vulnerability, something like that. I could be like slightly off there, but basically a ton of customer data was available on the Internet. I was like, God damn. Wow. Yeah.

On the idea of open source, what are your thoughts like? Do you think that's a good thing to have these things kind of out in the light or do you like the more proprietary version of it?

I think it's one of those.

Well, first of all, I think they're not truly open source. Right. So they're like open weight. They're not. You can't reproduce it yourself, right? Yeah, yeah, Nothing and build it yourself. Right. Because data centers on data centers.

This, this is going to hold it. All right.

Exactly. So, so it's open weight is, is cool. And I think it's obviously great for things like, you know, if you have an air gap deployment or you kind of strict security, you know, concern, obviously it's great. It reduces the, I mean, unless you have great kind of engineering talent internally, it reduces your kind of velocity on the ability to iterate on new models. Right. It's not as simple as changing a little string in your OpenAI call anymore to the new model. It's like you have to get that model and deploy it inside of your whatever system you have. So I don't know. I, I think it really depends on your use case. Does everyone need, you know, like Claude4 to really look over some little thing that they need AI for? Maybe not, right? Maybe you can increase accuracy and reduce cost and, and you know, I'm always.

Coming with a tank. I'm always coming with a tank that's.

Really bringing a tank to like a knife fight. If you classify like dog or not dog with, with clot for, you know.

No such thing as overdoing it. No such thing. Not at all. Let me ask you with, with respect to the AI security because I know we've, we've talked with other people in other fields and you know, there's always that one thing that's like a, that's a common myth, right. With respect to what they do, is there one that stands out to you when you tell people what you do, that they just have this like misconception about it?

Yes, I think so. I guess there's, there's at three different points on that one is a misconception about what we do at all, which is like, oh, so you guys are using AI for security is always. Yeah, is the way people mainly think about this. Like when you say those words right, they're like, oh, so you're using an LLM system to like pen test some traditional web app or something. So that's number one sec. The second bucket, I think for people who are kind of outside of technology is always like, oh, so that means you're going to protect me from Terminator, right? Like that's like the kind of common. You're going to stop a Terminator like event happening. And I'm always like, I guess, yes, you can think about us that way. I personally think we're not doing something that cool.

Oh, come on. You should always take credit. Just take credit for that. In terms there is not theirs because of you.

Like you guys are building the T1000 in the back room. It's okay, you can tell everybody. That's fine.

Yeah, we are not saving Sarah Connor. You know, we're not doing that. But yeah. And then I guess those are the two main ones then for developers and more technical. A more technical audience. Something that they kind of usually misunderstand about AI Securities. They always think we're trying to stop just pure direct jailbreaks and prompt injection, you know, trying to bypass a content filter on, like, a model. And they're like, why is that a big deal? And like. And we're always just like, that's not what we're concerned about. You know, like, we're not concerned. If you get the LLM to say something funny, like, that's. Like, that's cool. But, like, that's. That's not a security problem. It's. It's fine. You can do that to yourself. Right. The problem is when somebody sends. Is able to get somebody else's lm. Send them fishing link, that's when I. That's what we're. We care about. And so it's. It's. It's kind of. Yeah, those are some of the misunderstandings.

We'Re always trying to.

To get over for sure.

Have you dealt with a lot? I think, you know, fishing links is one thing, but what about, like, you know, voice, you know, and video now?

Are you.

Are you dealing more and more with that?

We have. We have something very interesting cooking on that front. So I will. I will say. I'll just say that. I'll just say that one day when we have some more time, hopefully soon we will hopefully get that out.

That's. That's a great, great. I like it.

Yeah. Yeah.

No, excellent. I love that.

Nick, John has got some questions in there he probably should deal with. Give them out of the queue.

Okay, okay, hold on, hold on. Okay, let's do the first one here. I was. I was looking at multiple tabs. It's really hard. You should see my setup. I have, like, a bunch of weird little things with all information, and it's like, I don't want to sound like I don't know what I'm talking about, and I don't want to be boring to people. So it's like, I try to have as much information, like, spread across. So now that I've defended myself against Dennis, here's a question from John. If, like, actually I can bring this up on the thing, right?

Yeah. Oh, I love this. Yeah.

If it is accomplishing the intended goal or task, do you care if it is AI or not? Would you pick one or over the other or does it matter? Interesting.

Yeah, that's a great question. And I think two parts, it depends, like, from a security perspective, I definitely care, 100% care. It makes a big difference because of the net new AI risk that it adds. Right. And so really the question that a buyer should be thinking about is, okay, is there an AI tailwind to this problem? Right. Like, is this. Are you solving the problem that as the models get better, your problem, your. The solution is going to get radically better as well? Right. And if it, if the answer is yes, it's probably worth thinking about the AI risk. Right. Making sure, obviously, that it's a good tool and it's a secure AI tool you're adopting, but after that, it might be worth it. Right. But if it's something that, first of all, it doesn't need AI and it's something that's a kind of solved problem that can be done programmatically in a deterministic way, I don't think you need AI, you know what I mean? So it's like, it's one of those things where it really depends on the problem you're trying to solve. For sure.

Excellent.

Thank you.

Do you ever imagine that AI could just be programmatic? I mean, would just repeat the same thing every time? Is that something that you could see happening?

I hope so. With the current architectures that we're using today. It's just not like. It's just, it's just. It's just a very hard problem to solve. How about I leave it at that? It's a very hard problem to solve. It's. It's.

I'm not gonna say it's impossible.

It's. It's a very hard problem to solve. And maybe it'll get to the point where for our, for all of the use cases we care about, it is essentially like that. And it's not. It's the. Maybe theoretically it's not like that, but essentially, in all practical ways it is. And then we gotta ask ourselves, okay, where do we care about if it is or not, if it isn't? How sensitive does a use case need to be for us to be like, we still can't use AI, Right, Right. Or how can we augment that with some programmatic mechanism to make sure it's better? Excellent. Excellent.

We're going to be coming up on time soon, so I really wanted to kind of just shift a little bit and kind of talk about just like, who is Vikram outside of AI Security?

Right.

One of the things I love to kind of ask everybody is a mentorship Question. Now, seeing as I. Well, let's. Let me ask the question first, because with AI being, you know, changing so, you know, rapidly, it's like a piece of advice that someone's given you about AI could have been obsolete, maybe yesterday.

Right.

But when it comes to like, mentorship is what's the best piece of advice someone's ever given you? And I mean, it can be about like, throughout your career. It doesn't necessarily have to be about AI security, but like, is there a piece of mentorship advice that you've been given that's really kind of stuck out to you?

That's a great question.

We're judging you on this, so it better be.

For a second here, I'm going to think for a second, not judging.

Me and Dennis judge each other all day, but we don't judge.

That's true.

Yeah, right. There's like, at least in your industry, like there's. Because of like the rapid change, there's fundamental things. Right. That can be like. And then too, like a follow up would be like, is like if somebody were, like somebody were just starting at promptomer, is there a piece of advice that you would give them? Maybe it's the same piece of advice too.

Definitely. Yeah. So I think. Let me answer the first part, which is a general kind of mentorship advice from my dad, which was, you know, always know why you're doing something when it comes to any kind of work that you're doing. Because sometimes you can really fulfill that same thing in a much better way if you had that context. Right. And also allows you to really understand and align yourselves with the value you're trying to provide. And it really makes you 10 or 100x more effective at what you're really trying to do. So I think that is something that definitely has stuck with me forever and hopefully will forever. And then on the AI side of things, I think this is something I was in kind of. We went through Y Combinator and there was like an event with Sam Altman, you know, with like, you know, a couple dozen of us in the room. And one thing he said, I'm pretty sure he said this publicly at Marketplaces. He's always talking about how you need to align yourselves with the models, basically with models getting better. So that's one thing in AI I think is really true. If you're building at the application layer, you want to think about how you can align the value of whatever you're building to benefit from the AI model tailwinds that will occur. So you want to make sure that you're not trying to fight against. That you're not trying to fight against gravity. Essentially, it's possible, but it's extremely hard if you're trying to go against the grain in that way. It's much better to go against the grain in some other dimensions than it is to go against the grain on AI. Getting better. Not bad. Not bad.

Approved.

See, there's no judging here. It's okay. Now, as much of a whirlwind as the AI security landscape is, what are some of the things that you do to unwind? Because I can't imagine, again, it moving so fast and things constantly changing and being added. What are some of the things that you do that kind of take you away from the typical 9 to 5?

I'm going to be honest with you, it's been a while since I've been able to consistently do that. It's a crazy environment right now, and we obviously have a lot of work to do. But when I do have time, I really enjoy playing beach volleyball in San Francisco. That's one thing that I did for, you know, at the time. I always try to make it out there. It's a great time. I'm not very good at all, but it's a. It's a great time. And then I still try to. I still try to read as much as I can. And yeah, those. Those I think are like the two main things I like to do. There's obviously great hiking in the Bay Area, so those things and you know. Yeah, those are chua. Yeah.

Aren't you a volleyball person as well?

Yeah, I'm super jealous.

Yeah.

Chicago. Yeah. North Avenue beach, like, when I. When I used to work on the city, I was about, I would say, like 15 minutes off of. Off the lake and could go to North Avenue beach, like, really, really quickly and did the tournaments there in the summertime. Yeah, it's. It's been a while, but yeah, it's. Yeah, I used to love. And then it's hard too. Like here in Chicago, you only get like, I don't know, maybe two and a half months of good beach volleyball and. And if not, then you're wearing a sweater and like sweatpants and you just got doing it. But. But, yeah, no, that's fantastic. I. I'm very envious.

It's not that warm out here, I will tell you that. Northern California. Oh, man, it's not like. It's not quite like la. You know what I mean? It's not like you're in. In shorts and, and a T shirt for sure.

Nice. And definitely envious. Yeah, no, that's. I love that. That's really cool. Is there a. I was going to say it's. Is with it being as busy. Like how is, is there a struggle with work life balance when it comes to.

I think you just said that basically.

Right, I know, but I just. Is there like my follow up was going to be like, is, is there something that, like that you do to try to kind of balance those two things out? Because we've heard like people, we've asked this of, of other people and there's been actually, you wouldn't think there's too many answers to have, but there actually has been because, you know, depending on your approach to work, like kind of dictates how you then try to balance it. Is there, is there anything that you do with the high demand of AI security? Is there anything you do differently, like when you try to balance those things out?

I wish I could tell you yes, it's really that crazy right now. I don't try to fight it. How about that? That's my approach. And so it's not stressful. It's like this is the reality. Right? There is, there is actually this much work to do and I'm not going to back down from a challenge. That's kind of my mindset and. No, it's. But I think honestly it's the team that makes it so easy for me to say that. Right. Like we're all giving each other energy because of how amazing our team is and how well we all work together. It's like one of those cycles where we're able to really kind of all push ourselves way past what we thought would be possible for sure. How about.

Can I augment the question just a little bit?

Yeah.

But let's say rather than the work life balance, let's say you get into a really, you know, bad situation at work. Like it's a challenge you're not able to, you know, get through, you're frustrated, you know, all that good stuff. How do you actually reset to actually deal with that?

That's a great question. I would say that, you know, sometimes you just need a good night's sleep. Right. I will say I don't. I try not to sack. I will not sacrifice my sleep consistently. That is one thing I think is a key to making sure this is sustainable. Right. Is that your is, you know, seven to nine hours of sleep a night. So I think a good night's sleep going to the gym. These are all things that help me reset, personally.

There you go.

I. I think those are things I. I tend not to skip either. So I. I definitely try to make sure both of those get done every day.

The sleep one. I, I think that's a great answer. I, I also, just as you were saying, I was thinking it's kind of funny how when you're coding your vibe, coding whatever you want to do with a LLM, you only give them a small, Like a small task due for, like, you reset to go to the next one. So it's like just go to sleep every time after every task.

Oh, that's Truman.

Yeah. Look at you, Dennis. That looks good.

Golly geez, I like that.

We're gonna. We're running up a little bit on time. But I did wanna. I did want to do two things. I wanted to give you an opportunity to plug anything that you wanted to plug on. And then final question that I wanted to ask you is if you could pick just one thing with respect to what you're doing right now. Like, what is the, like, one favorite part about what you're doing right now? What is the one thing that, like, gives you the most satisfaction right now that you're doing, like, with. Within the.

Within the security route, other than talking to us, clearly.

Oh, yeah, of course. I mean, that's always a given. We kind of just. That's a little footnote in there. It'll be in the show notes eventually.

But, you know I'm gonna be back on every week, right? That's. Yeah, Yeah. I would say, honestly, it's problem solving with the team. I know that's not a very specific answer, but that motion of, like, here's this new problem we're trying to solve, and then all of us, you know, throwing our heads against the wall, solving it, and then we all usually have a very good answer at the end of it. So it's. It's like one of my favorite processes ever. So it's been great. And again, that's a factor of, you know, hiring a great team and working with great people. So I guess that's one thing I want to plug, is we're hiring.

There you go.

Please reach out to me if you see a job posting on our website. That's great. We're looking for talented people in engineering threat research, so feel free to reach out. That'd be great.

Nick, I think you got a job. All right. You got through the exam.

I'm sure anyone that's watching at HubSpot wants to hear that. Dennis thanks, but no too. And it's also a testament to that. And I'm going to throw this up there for people. You, not only is it like you're, you're problem solving, but you're taking that knowledge, right? Maybe like not trade secrets, but you're taking a lot of that knowledge. And you and the team are building like education off of that, which I think is I, you know, if I, if I could thank you for anything, it's the fact that you're doing that is in a world right now where, like we said every two. Let's, let's use the analogy of the every two weeks. But like, still like having something out there like that that's. You're able to kind of like it almost kind of like, you know what I mean? When you feel like you're floating away, it kind of like keeps you grounded. It really does. Because, you know, at a certain point you could start going down a rabbit hole of reading just about everything about anything about what, you know, AI and then the security around it and it all starts to kind of bleed together at a certain point. The fact that you guys have what you have is just remarkable.

Seriously, thank you so much. Yeah, that's, that's great to hear. Yeah, that is another great part that I really love is this is talking to people that are interested in AI security and helping educate them as much as we can.

So anybody listening, go to promptarmor.com if you want to learn more about Prompt Armor and everything that they're doing. Yes, they absolutely should. Because it's like I said, there's a lot of, even when I was first, like, kind of getting into everything, and I'm no expert by any stretch of the means, but like, there was this kind of. Again, there was the misconception of what was actually AI and what wasn't. And then there came the kind of at scale, like, how do you deal with some of these things and the problems that are going to start to come up, right? Because at a certain point you have to imagine too, like when, let's say a small, you know, maybe a single entrepreneur or small group of people start to take AI and build 10,000 people out of that right there becomes. And 10,000, you know, whether that's agents or like, like a workforce that acts like 10,000 people, you're also going to have the security problems within that of a place of 10,000 people. You know what I mean? And then imagine attackers that are now attacking as 10,000 people when they're not like, it Opens up a world that I don't think, like, without people like Prompt Armor, without you and the rest of the team, it's not. It's not a good. It wouldn't be a good look without it, let's put it that way.

So.

But thank you again. I mean, this has been fantastic. Is there anything else that you wanted to shout out before we kind of sign off?

Shout out you both for having me on and making this a great experience. This was really fun. A lot of questions I did not expect and were really interesting. Loved it. Yeah. Wow. Thank you.

You can come out again then.

Awesome.

I'll be honest, I was telling Dennis at the beginning. My fear was I was going to sound like I had no idea what I was talking about, because it's moved.

So, yeah, this was.

This was great.

This was like. Yeah, I mean, you clearly took the course.

It definitely helped. Again, anyone out there, you definitely need to be taking this course because it was really fantastic.

So.

But thank you again for coming on.

We really appreciate it.

We had a really good time. And, you know, for everyone out there, I'll kind of leave you with this. I had my movie server on random, and I'm glad we brought this up. This actually came up once or twice in the conversations here, and Terminator 2 actually came up in the. In the queue. And I thought to myself, and this was the other day, I was like, can you imagine how boring of a movie series that would have been if Prompt Armor existed in that timeline? I mean, Skynet would have never went to production. John Connor would have never been in danger. I mean, that's something to think about right there. Just so you know, protect us every day.

I'm going to start saying that I'm stealing.

No trademark. It's all yours. But thank you again, and thanks everyone for listening, and have a good weekend.

Later.