#130: Strategy | How to Measure Your B2B Marketing Efforts (With Pranav Piyush, CEO and Co-Founder of Paramark)
8 Apr 2024 · 56 min
Pranav Piyush, CEO of Paramark, discusses how B2B marketers can measure their impact and prove ROI to executives. The conversation covers marketing mix modeling, incrementality testing, and why attribution alone doesn't tell the full story of what's actually driving revenue.
This episode is brought to you by Zttle. We're halfway through 2025 and one thing's clear. We've been feeling this firsthand for sure. Events continue to be one of the highest performing marketing channels. Niche meetups, conferences, curated dinners, networking, breakfasts, everyone's all in. Everyone's leaning into in person. Events have become a core part of our playbook here at Exit 5. So far, we've hosted two virtual sessions. We do them twice a month. We do one large virtual event, sometimes two a year. One in person meetup. And we're deep in the trenches right now planning drive our annual conference coming back to Vermont in September. We use Zuttle to help us run a smarter event strategy. They help us with driving registrations, managing invites, automating, communications, reminders, analytics, tracking. They do it all. They have a salesforce integration that also makes it easy and simple to report on pipeline and revenue from events without having to pull an op. So you'd know exactly how your events performed. On top of that, the differentiator with ZTTL is how their team is insanely good at supporting us. They always go above and beyond for us and that's how we've been able to keep the momentum going with 12 events this year already and just a small little team here at exit 5. So if events are a part of your marketing strategy like they are ours, you should check out Zuttle to see how Companies like Zillow, CrowdStrike and Iterable are using the top event platform for business events in 2025. Head over to zuttle.com exit5. That's z-u- dash dash l.com exit5 to learn more.
One, two, three, four. Exit.
Exit.
Exit. So, without further ado, Pranav, I'm gonna turn it over to you. Let's kick things off. All right, here we go.
Thank you, sir. Hello. Hello, everyone. This is amazing to see all of you from everywhere around the globe. This is going to be a fun session. So as Dave mentioned, this is not going to be a boring webinar. This is going to be an interactive session. I'm going to make sure of that's.
Because it's not a webinar. You said it.
Okay, so you know the top. And I heard from Dave, right, Like, this is a popular topic around how to measure your marketing efforts. This is the evergreen topic. Everyone's always talking about it. And I'm particularly excited because I'm going to tell you it is not that hard. It is not that hard. This is something that you can achieve like today and tomorrow and make it really practical. And we're going to talk about that stuff today. So that's the quick sort of intro to the session. I'll tell you a little bit about myself. So who am I? I have spent the last 15 years working at companies like PayPal, Dropbox. You can see the logos here all across strategy, product growth, and then marketing. So I was one of those weirdos who thought, oh yeah, marketing, that's easy, I can do that. I raised my hand and said, yeah, let's go figure out how to do marketing. And then really learned how hard it is. The combination of the creative and the art and then being able to stand in front of your executives and your board and talk about what business did you drive for your company and realize that that's hard and we can make it easy. And that's what I'm here to do for all of you, hopefully. So based in Burlingame, California. If you're in the neighborhood, you know, say hi, we'll catch up over coffee and what have you. So the first thing that I like to talk about when we're talking about marketing measurement is investor first, marketer second. So what does this mean? All of us when we are thinking about marketing measurement are thinking about, this is what I can do for the business, this is what I have done for the business, this is what my team has done for the business. We deserve more, we deserve more credit, we should be celebrated more. But you have to take a giant step back and think about what is the goal of the business and the people who are funding that business, whether it's bootstrapped, whether it's VC backed, whether it's a public company. At the end of the day, there are shareholders and investors and board members and executives who think about things like return on investment. And you have to think about investment first, then investor first mentality before you think about all the amazing creative ideas you have as a marketer. And that's a very important starting point because it reframes how you think about measurement. So that's step number one is think about and put on your investor hat. And as an investor, if you wouldn't invest in a certain business strategy, whether it's marketing or sales or product or you know, a distribution method, then everything else doesn't really matter. Right. So that's step number one. Yeah.
What you said is like this is also step number one in just like there's a discussions come up a lot in exit 5 or just beyond a lot of the Audience here are folks that want to or are move into a marketing leadership role. And oftentimes we'll ask what's the difference between individual marketer or maybe like small team manager into marketing leader? And I think it's this. It's marketing is the thing that you own, but you are responsible for the business. You have to understand the business strategy first. And I feel like at least in my career, anytime I felt misaligned it was because I didn't fully understand like the company strategy. When I was really tight with the CEO, my life as a marketer was much, much easier. Just removed all the bullshit and like helped me focus on what matters. So I love this frame of investor first, marketer second.
Nice. I completely agree. And now don't get me wrong, there are many companies where the strategy might be messed up or non existent. So I'm not saying that you're gonna just get it right if you think about investment first. But if that is the case, you need to call it out or go find a different job where the strategy is sounder, where you can have an actual impact with marketing. So that's step number one in my mind. Step number two, and this is something that I will talk about a lot, we use these words, right? So justify investments, right? Marketing, sourced marketing, influence, marketing attributed. We use these words. But if you take a giant step back and think about what are you trying to achieve with marketing, it's going from a smaller business to a bigger business. Pretty simple. And at the heart of that conversation is this word called incrementality. This might be new to some of you, this might be new to many of you. It was new to me a few years ago when I first sort of encountered this word. And what this means is are you adding incremental net new business for that company and not just fighting over credit because that is not important if the business isn't growing, if your new sales aren't growing, if your new leads aren't growing, if your new traffic isn't growing. And that's another sort of important reframe. It's not about the credit and the attribution. What it is about is are you adding net new on top? That would not have shown up at the business if you weren't doing your job. And if you reframe it that way, it all comes full circle to that investor mentality. I'm going to pause and see. Dave, if you have any thoughts on this word. I know incremental can sometimes be perceived as this. Like oh, it's Just like, you know, doing small things. But that's not really the meaning of the word. It's incremental means that it's on top of the baseline, on top of what's already coming inbound.
Yeah, I think it's easy to just get caught up in trying to have the perfect end to end solution for measurement for marketing strategy. Like I love this idea and some of the most fun that I've had in marketing is at a smaller company when you can shrink things down to what are we working on this week? I think it gets hard as you stretch those things out. But I love the idea of incrementality and just thinking of like, look, we're trying to get here, we don't have all of the data, we don't have perfect answers. But like every day, every week, every quarter, we're going to get closer and like, look at what we'll be able to do now. I think about, I think about HubSpot a lot as an example only because I happen to work there early in my career and to see where they are now, I just recently did a podcast with Kip, who's the cmo. It's like every problem or challenge they had like seven years ago when I worked there, they've solved or iterated on. And these things just take time when the longer you have smarter people working on the, the business. So I love this approach also. Anytime you can throw Mario in the, in the deck. I spent 150 bucks on eBay to get my kids a Nintendo 64 so we could play Mario Kart. So well done.
Yeah, I got my 7 year old the Nintendo Switch. So she's all about exploring just to build on that.
So I went super, you know, early days OG so I said we can get a Nintendo 64. We went to my cousin's house, they had Mario Kart on the Switch and my son looked at me, he's like, dad, what is that they're playing? I'm like, it's the same game. Just 30 years of graphic advancement.
Yep. Hey, don't change what's not broken. Right? Okay. So when we talk about this concept of incrementality, getting more specific, what does it mean? What is incremental? And I boiled it down to this like graphic. And this is a really important one and hopefully it'll help you as you think about sort of your marketing measurement challenges. Think of it this way. If a prospect would have become a buyer regardless of what marketing that you did, then that marketing isn't really incremental. And vice versa. If a prospect would have never become a buyer until and unless they saw a piece of marketing, then that piece of marketing is super incremental. That is the heart of the marketing measurement problem. And the question that your CEO, that your board is trying to answer is that campaign, is that channel bringing in incremental net new leads or sales that would not have come to us anyway. And if you think about it that way, everything else will figure itself out. Now, I will add something here. It doesn't matter how many clicks you get, how many impressions you get, how many people say what on your self reporting, you know, forms, all of those. I get what you're trying to do. At the end of the day, the discussion is, would those people have come to you anyway or not? And if you can answer that, that is the holy grail. So again, I'm going to pause and see Dave, if you have any thoughts on this.
I just screenshot this and I sent it to our team internally because we're trying to figure out how to repeatably grow exit 5 right now. And we're just, you know, we've just hired a team, we've just invested, and we're, we're trying to start new channels. And like, we have this baseline of how many people show up to our website and start a trial when we don't really do anything. Now we're doing stuff like we're writing on LinkedIn, we have a newsletter, but that's kind of all kind of steady state stuff. Right now we're trying to figure out, like, okay, how do we go from 200 trials a month to 225 to 250 to 300. I literally just screenshotted it. And I'm typing up this note as I multitask here because I'm like, yes, this is how we figure out, like, what we need to go and do next. Like, exactly your baseline. And there aren't. There, aren't there those classic, like, I think it was ebay was one and Airbnb was another, where they turned off paid search and all the same people still showed up anyway. Is that kind of what you're. What?
That's exactly. Okay, yeah. If you Google ebay paid search experiment. This was, I think, like 2010 or something, like way back or might have even been earlier than that. They were the first ones to run this giant experiment of let's stop paying Google money for a little bit and see what that does. And it turns out everybody was going to ebay anyway. Those ads were Just siphoning off credit at the bottom of the funnel. And so you really have to think about the incremental impact of every channel and strategy. And it's hard, right? It's not easy to get this answer. We're going to walk through how you can do it at a small budget and a large budget, but it's critical to at least know sort of what, what it is that you're aiming for. Okay, Now I will also say this, right? So we talk to marketers all the time at all stages of, you know, growth. And the six questions that always come up are these six questions. There isn't some like, you don't need to answer these 500 questions to get marketing measurement, right? It's these six. If you can answer these six for your CFO or your CEO, you're done, you're going to get promoted. No questions asked. If you can answer these questions. So think about that. And everything rests on the first question of incrementality. If you don't get that question right, none of the other math actually makes sense. So remember that. Now I know we had a little bit of a clickbaity, I don't know, maybe you know, subheader on our non webinar that said, you know, click attribution is dead. What do I mean by that and why do I say that? And I have nothing against tracking clicks, measuring clicks, just like I have nothing against, you know, tracking self reported attribution or measuring self reported attribution. You have to however, go into the real depth of what you are capturing with that tracking and what you're missing. And these are the four points that you should just be aware of. Number one, just by the virtue of the fact that you're tracking clicks, you're going to be biased against many channels, video, social, whether it's organic or paid. Obviously anything that's happening in the real world, right? Connected TV, YouTube, billboards, direct mail, none of those are going to get captured in a click based attribution model. The second is all the offline marketing, even things like events, billboards. Well obviously you're not going to be able to capture that in clicks, right? And then all the changes that are happening in the privacy side of the house, I discovered this. Dave, you'll find this funny. Apple in the summer of last year started to strip out UTM codes from Apple mail and Apple messages. And I'm like, what? Yeah, that's happening right now. And every year some new sort of privacy change that comes about, especially from the likes of Apple that makes it harder to use click tracking the same way that you've been doing for the last 10, 20 years.
Steve Jobs would be rolling in his grave if he knew about UTMs. Because I forget which book it was that I was reading. Maybe it was this book called Insanely Simple. But if you've ever seen the URLs for, like, launches that they do, it's like apple.com iPad or apple.com Pro. We have ruined that. Like, I love the vanity URL. Like, yes, let's. Let's do better on our end to, like, drive to a page. Like, we put so much like, okay, you got to have this utm, because if you. Somebody didn't click through this UTM link, like, it didn't happen. Well, like, guess what? I delete all those utms out all the time because I just think the clean, simple. Look, Dan and I were. We had this argument a couple weeks ago. He's like, yeah, put this UTM in your, you know, Twitter bio. And I was like, no, that looks awful. Like, it looks like exit5.com?_ utm source. Like, it should just be clean. It should just be exit5.com and we should figure out how to measure it from there. That's at least the dream, right?
Yep. I think you're 100% right. We did something similar. You know, we're fortunate that we're a young company and we can make these decisions right now. But we decided no UTM codes ever. No cookies on our website ever. No click IDs. No, none of that on our website and our business ever. So. And I think it's very possible there's other businesses who are doing very similar things. And, you know, we can. Happy to chat about that with other folks. The last piece that I will add here in terms of clicks is to understand incrementality. You're really trying to understand causation. Right? What that means is I did this thing in the real world in terms of marketing, and it caused my business to grow. And just by tracking the stream of events or clicks, you don't have a sense of causation. Forget about even correlation. That's also not happening. It's what I call coincidence that those clicks happened. And that's the thing that you have to remember now. It doesn't mean don't track these things. It just means don't use them to answer the question of ROI and incrementality. Okay, so lots of buildup. So what is one supposed to do? Right. I'm Painting this, like, really grim picture. What do you do? How do you make this work? The first thing that I will say is if you are spending a few hundred thousand dollars a year, if you're, you know, less than a million dollars in marketing spent across paid, owned and earned, and if you're primarily working with one channel or maybe two channels, I would argue you don't need much other than a spreadsheet. This is true for our business, right. I have a spreadsheet that tracks the key sort of fundamentals of our business, which are things like how many people showed up to our website. You don't need any fancy tracking for that. Everyone has that. How many people raise their hand on our website and, and said, give me a demo. Very easy to track. I can look at that over time. I can see my organic social activity. That's my only channel today, right? Organic, social and community. And I can see how many impressions I'm getting on every single post. The correlation will hit you in the face with a simple spreadsheet like that. So that's number one. If you're a small business, if you're a marketing team of one, and you want to get this up and running and just a simple spreadsheet to simplify your life, like, shoot me a note, happy to show you how we do it and help you out. But as you grow and as you get multiple millions of dollars in budget and now you have multiple channels, you've got LinkedIn going, you've got meta going, you've got events going, you've got email going, you've got Google search going. Then it becomes really hard to understand which of those is really causing your sales to go up or not. So the first thing that I say in this process, I've got five steps. So we're going to walk through each of these steps one by one, and it'll be quick. First step, you've got to model out your business. Okay, what do I mean? Here we all talk about, you know, and one word that you will not see on the slide is leads, because I think that word has been tainted. It's a perfectly good word. There's nothing wrong with leads, but I will not use it because everyone will shit on me if I were to use it. Sorry for the French. Okay, so I'm using those.
I love lead. Let it be known, Put it on the record. I love leads.
Yes, great. So I'm, I'm calling it a handraiser. And I think that that was the true definition of lead. Right? What this is Saying is give me a demo, give me your pricing, let me talk to sales, let me in. I'm raising my hand and telling you I'm interested in engaging with your product and getting into, you know, a buying process. And so if you start with that, that is a leading indicator and you want to really understand what that is looking like for your business over the last 12 months and what the forecast for the next 12 months is going to look like. If your sales cycles are long, you got nine months, 12 month sales cycles. We deal with that on our business. You don't have 12 months to see the attribution on a deal. Before you decide whether that piece of marketing is working or not, you need to have a leading indicator. And so model your business, understand the variables in your business model and which ones you're going to optimize towards. And you want to pick metrics that are aligned with your customer journey, not how you like to think about things in terms of scoring and quality and qualified. Like all of that jargon is not necessary. So that's number one, model your business, understand the key inputs that marketing can truly impact. Before you think about how do you measure the impact on those metrics?
Yeah, it's great. I think this is an important step and it's, it's easy to just get sent in a bunch of different directions trying to figure out like what to measure when not everything matters and not everything holds equal weight. And you do kind of have these different paths that you're trying to push people towards. Whether it's get a demo, contact sales, start a trial, sign up for the free version. And so I think getting everybody in agreement on like what is the buying journey, what is the buyer's journey here then we can layer on how we're going to do marketing, where sales is going to come in and how we're going to measure this.
Nice. Exactly, exactly. And I will say something, right, this idea that marketing can somehow influence every part of the journey is just completely wrong, right? Like once you get somebody in the funnel and they're an opportunity to go from opportunity to a deal, the amount of impact that marketing can have on that is minuscule compared to the sales experience, the solutions experience, the pricing, the actual product. If you have like a, you know, pilot process and all that stuff. And so you might actually be wasting your effort trying to get like deal acceleration or pipeline acceleration if the ability of marketing to drive that is, is non existent. So just think about that and be really intellectually honest about what you can actually move for the business. Okay. Second, measuring what matters and understand the correlation between inputs and outputs. So how this works. And like I said, you can do this in a spreadsheet. And if you don't have a business analyst or somebody who understands data, who understands correlation, then I recommend two things. Either go hire somebody or go find a vendor who can help you do this type of math. But once you've modeled your business and you've said, okay, we're going to try and increase hand raisers because that is the leading indicator, that is the, you know, demos, the trial starts, all that fun stuff that we want to sort of grow for the business. You're going to look at every single marketing channel, whether it's paid, whether it's earned, whether it's owned. So pr, direct mail, events, organic, social, paid, social, paid, search, everything. And you're going to map out the last 12 months or more of reach and impressions across every single channel. You're making them apples to apples. That's number one. And that's why we're picking impressions. And you're going to see, when my reach on Facebook goes up, when my impressions on Facebook go up, do I see a corresponding increase in my demos or not? When my impressions on Facebook go down, do I see a corresponding decrease in my demos or not? Very basic, very simple. Something that even a 10 year old should be able to understand. And when you do this over a 12 month time period, over a 24 month time period, you will figure out the correlations between each marketing channel and campaign and your demo volumes. That is the idea behind understanding the correlation between all your marketing channels and your outputs. And what usually will happen is you'll get an output back from this. That shows you, oh, Facebook seems to be very highly correlated. Every time you spend more and have more impressions on Facebook, your demos do go up. Or you might see that, you know, Google is not correlated at all. This is a hypothetical example. I have nothing against Google, I love them. But just showing you a potential way of looking at the business. Okay, so what does that do for you? What is next when you pull that model together, Whether it's a spreadsheet, whether you hire a vendor, whether you have a data science team doing this for you, it outputs something like this. You literally see incremental versus baseline as an output of that model. And I'll go back to the question that we started with around this question of incrementality, right? So you're using statistics on top of all the things that you measure and you're now seeing Your overall impact of all your marketing investments, how much incremental business did that drive versus what was baseline, which is your organic demand, your word of mouth, your built up brand equity. So going back to Dave, that you were saying about Exit 5, you already have a baseline of, you know, whatever, 200 trials a day or a week day would be nice, wouldn't it? And how you go from 200 to 25, this is what you're going to get out of that analysis. All right, my favorite statement, correlation is not causation. So let me explain what I mean here. Just because a couple of trend lines move in the same direction doesn't mean that there is a causal relationship between those two trend lines. And it is possible that you said in a previous example that, okay, every time we invest more in Facebook, you know, your demos are also going up, but maybe there's something missing in the data that just at the same time when you go up in Facebook impressions, you're also doing events and somehow that got missed in the data set and so you're finding a correlation where there may not be any. And so this is the next step in marketing measurement, which is causality. And this is all about experimentation. And it might seem, you know, well, we experiment all the time. Don't.
Today's episode is brought to you by ahrefs. You probably know Ahrefs as an SEO tool, right? I've been using Ahrefs personally for over a decade to see how we rank and see what's driving traffic to our site. Content marketing has always been a big part of the playbook. I use their product at Drift, at Privy, and now we're using it at exit 5. But over that time, Ahrefs has evolved a lot and they're not actually just an SEO tool anymore. They're a full on marketing platform built for marketers like you and me who want to grow traffic, understand our audiences and make smarter business decisions in the AI search world. Their marketing intelligence lets you see what's driving traffic to your site, to your competitors, understand top performing content, paid keywords, backlinks, and you can even understand how much or your organic traffic would be worth. Put a actual dollar amount to all that organic traffic that you're driving. They've also Got Tools for AI Powered Content and Keyword Research, 24. 7 Site Monitoring, Real Time analytics, backlink tracking, brand mentions, you name it, you can do it all in one place. With Ahrefs, it's really a marketer's dream. If you're a marketing nerd like Myself, one of the coolest features in my opinion is their new brand radar tool, which allows you to explore what people and AI says about your brand, topic or niche. You can do this to do amazing research to help understand what's actually happening in AI Search today and just what the conversations are online about your brand. Plus, you can try their free analytics tool to show you how many visitors you're getting from AI search like ChatGPT or Perplexity. And look, as a firsthand user of this, so much easier to use than something like Google Analytics. I love it. We use it on our site. I've used it for Exit 5 and we just found out that over the past 30 days we've got 105 visitors to Exit 5 from AI search. 95% of that was from ChatGPT, 5% of that was from Perplexity. But it's really cool to understand and this is the way that search is going and shifting. So Ahrefs not just an SEO tool anymore. It's a legit marketing platform for anyone serious about growth in today's AI driven search world. If you do any type of content marketing at all, you gotta go check them out. Go visit ahrefs.com that's a h r e f s.com today. Go check them out.
We in marketing and I'm here to tell you that you probably are not running experiments the way you should be running experiments. So there are three ways in which you can run experiments in marketing. One is pretty much there are only about three platforms that offer this capability natively. There's Meta, there's YouTube. And I think TikTok is getting into it. And this is called a conversion lift test methodology where when you go into Facebook and go into the Experiments tab or the same thing in YouTube, you, you can set up and tell Facebook to split your entire audience into a control and a test bucket. And they will then ask you to upload your hashed conversion data to Facebook. And then they will tell you that when you serve your ads just to the test bucket, what is the incremental impact of that spent? And you're not using clicks and touches to inform that measurement. You're using your first party data that you're feeding through an API back into Facebook. So I'm fairly sure that a lot of folks have not heard about that testing capability. It is not the same as AB tests that are shown in the ui. This is something that is a lot more hidden and I can explain why it's hidden in Facebook, but that is the first option that you have now, what about a channel where you don't have a native conversion lift capability? The second method is actually much simpler, geotesting. What is geotesting? It's literally turn your advertisements or whatever marketing strategy that you have, turn it on in a couple of regions and turn it off everywhere else. Pretty simple, right? So I'll give you an example. If I wanted to turn on LinkedIn advertising tomorrow for Paramark, that's what I'm going to do. I'm going to say I'm going to turn on advertising in California and New York and I'm going to turn it off everywhere else in the US and now I'm going to track my traffic, I'm going to track my leads, I'm going to track my demo signups from those two regions and everywhere else in the U.S. no special software needed. You can do this yourself. If you are at a low volume of spend and you can start to see a pattern immediately and go back to your CEO and cfo, hey, look what happens when I turn on advertising in these couple of states and, and it's often everywhere else. You have irrefutable evidence about your lead volume, your traffic volume. The easiest way of proving the impact of what you're working on. No software needed.
One time I was at a company and we raised, we raised a bunch of money and we did a huge press announcement. We were featured in all the top publications and that day was the biggest spike in inbound interest in the company ever. And I hated that because for the rest of my life, the rest of my time at the company, we always looked back at that spike and whenever someone be like, what did we do that day? And I was like, well, we've raised $65 million. If, hey, look, if you want to, if you want to do that once a quarter and give me that, I'm happy to make a big announcement and a big splash. But I wish I could say this is repeatable, but it's not.
Yeah, that's exactly it. And I am very confident now, having been doing this for a few years, that every single marketing channel strategy can be tested with a control and test sort of mentality. And you don't need a ton of support to be able to make that happen. Now if you're spending hundreds of millions of dollars, billions of dollars, like some of our clients do, then yeah, you're going to need a little bit more help because now you're running, you know, 50 tests at the same time and you're slicing and Dicing the data by DMA and geography and in many ways around the globe and it gets complicated. But if you're starting off this is the simplest thing that you can do. I was talking to a marketing leader at a seed state startup just a few days ago and she was asking me about, hey, how should I think about growing our non brand search, you know, ad spend in a profitable way. This is what I told her. Whatever new concepts you have, run it in just one city and see how that works for that one city. Do you get more traffic? Do you get more leads? And if you do, you can scale that up to, you know, as many geographies as you need to and that gives you a repeatable process to test and learn any new strategy. Now there is one other methodology. Even if you don't do geo testing, you can actually do a time based test. This is in layman's terms, you turn something on and you turn something off again. That's another way for you to get data. I'll give you an example. I actually ran this test for our own business in December. My posting frequency on Organic Social was like half of what it was in Jan. And I improved the frequency and I changed a couple of things about what I was posting about. And I can tell you with extreme certainty, looking at my data, that the spike that I saw in leads in January versus December was a direct result of that change in intensity and change in tone. And so you can show that with evidence to, you know, your leaders if you, if you know what you're doing and how you're constructing that test. Okay, step number five, this is the last one. So you've modeled the business, you have measured what matters. You've estimated incrementality using correlation. You have now run experiments to understand the causal impact between your marketing investments and your business outcomes. The last step is probably the most important step when you're talking to execs, and that is forecasting at the end of the day what they care about, what your head of sales cares about, what your head of marketing cares about, what your CEO cares about, what your board cares about, where are we going to be in the next quarter. And everything that you've done up until now is helping you inform this answer. And what I will also tell you is that they're not looking for this precise number of you must hit that number. That is not how CFOs think, that is not how boards think. They're actually looking for your best case and your worst case scenarios. And they're going to do risk management. On top of that, when they report out numbers to the street, if they're a public company or even if they're reporting out numbers to their board, they're never presenting one number. Never. So when you understand your historical numbers of the last 12 months and you have this model set up, you can actually. The model will predict where you will be in the next quarter and with all of your marketing spend accounted for, and that will allow you to then generate a forecast and you go in with a range of this is the best case, this is the worst case, and here are all the experiments that are in play to try and beat the best case and go even higher. And that's the communication sort of, I would say, skill that you need to develop to be able to talk to your boards and your execs and your finance team in a smart way. That's what they're expecting. All of the stuff that I talk to you about today can be done with Excel. It can be done through open source data science models, it can be done through vendors. There's many of them. The industry term for these things is marketing mix modeling, incrementality testing. You can put that into Google and you'll see a whole bunch of vendors. Obviously Paramark is one of them, so check us out. But that's something that I would recommend. Anybody who's spending more than a million, two million, you're starting to get to that scale. This is the way to run your business. And it's not just me saying this. We've talked to marketers at companies like Asana, Doordash, even PNG and Unilever, Indeed Square. These companies are all using this type of methodology across B2B and B2C. And there's no reason you can't do this yourself. So that's the meat of the topic today. Dave, any questions, reactions at this point before we go into our special session right after this?
No, this is good. I think, for me, I think this was helpful because I think more than saying like, hey, use this software, use this tool. What you presented was a fundamental approach to measurement where you have to be able to think about your business and understand where measurement fits in, as opposed to just being like, let's start measuring everything. This is very much driven in how does our business operate, what matters. I will say one thing that I wish I was better at earlier in my career was the forecasting piece of it, because I was so focused on the short term. Like, what are we doing this month, this quarter? The ability to Be able to, you know, measurement to me isn't just important because you need to justify spend. That's one way to think about it. Measurement becomes really important when you say, okay, we did a million dollars in revenue this year, we want to go to $3 million next year. Where is that going to come from? That's where measurement becomes really important because you need to know what you did with what the numbers look like, how things worked, where you can place bets. And I think that's something that I struggled to do earlier in my career where very being very short term quarter focus, when like all of a sudden the plan jumps 10%, 25%, 50% over the next couple years. You need time to ramp up those channels. You're not just going to be like, wow, we need, you know, 500 new hand raisers this quarter. Let's go try LinkedIn ads for the first time. It's, it's not going to work. You need to back to the point about incrementality. You need to be able to do that stuff early on and test into those new channels. And that's where this is really important.
I agree wholeheartedly. And something that we did not cover today is when you do this type of analysis, it helps you develop recommendations for your business that say things like, you probably are oversaturated in a certain channel and pouring more dollars into that channel is not going to get you incremental returns. So think about reallocating to this other channel because that one seems to be under saturated things of that nature. Right. So you'll get that as an output from these type of analyses. And whether you do it in house or you find a vendor to support you through it. And then the last piece, I will say about experimentation to your point, I don't know if people are aware of this or not, but we looked at experimentation data from companies like booking.com and Amazon and Airbnb and Uber and Microsoft. 70 to 80% of experiments will fail. Let that sink in. Right. What that's saying is you designed 10 experiments for this year. 70 to 80%, 7 to 8 out of them are just going to fail. They're not going to bring in incremental returns. And that is something that's really hard to swallow if you are doing new stuff for the first time. But that is an expectation that you need to set with your marketing and finance leadership, that you need to have an experimentation budget. And the goal of that budget is not to get you slam dunk, you know, incremental returns. It's about finding the two or three things out of those 10 that if they hit, they're massive.
All right, let's rip through these, rip through these questions. Let me just pop in over here. All right, cool. This question is from Ian. For B2B ad spend, do you believe.
That there is a shift to meet.
To a media mix model rather than multi touch attribution?
Absolutely. I mean, I'm obviously biased, right? This whole idea of using touches or clicks or tabs, to me, if you're not doing correlation or causation on top of that data set, then it's not really attribution in my opinion. So you want to call it attribution? You can, lots of people do. But again, it goes back to if there's no cause and effect relationship, then I personally wouldn't call that attribution. And yes, media mix modeling is where the future is at.
Great question here from Erica related to.
What we just talked about.
How do you think about short term incremental revenue versus long term investments where revenue is realized at a later date? Great question.
This is the holy grail of marketing measurement. So I think of it in the following ways, right? And some hot takes coming, so please don't judge. We put all of these, you know, different channels and tactics and marketing, we put prefixes on them, right? We call something brand marketing versus performance marketing versus growth marketing versus customer marketing. And some of that is because of this long term and short term and people's inability to kind of see through the entire time horizon. And what I will tell you is whether you call it long term or you call it short term, every piece of marketing is going to have some effect in the short term, every piece of marketing. So this idea that some marketing only works in the long term is just completely not true. Every piece of marketing, if it is effective, is going to bring in returns in the short term. You just don't know how to measure it. And that's why you end up saying that, well, it's long term and we're going to get that in three quarters. Nope, that's not how marketing works.
I want to build on that. This question is from Dave Gerhardt.
Hi.
How do you think about measurement for non direct response initiatives? Kind of building on this. It's easy to do a campaign or to run some marketing efforts on a specific channel. But I've been at companies where we've had channels like a podcast, where the goal of the podcast is not to drive customers, but because we had a podcast, we ended up getting a lot of customers from that. But maybe you know where I'm going this. But it doesn't work like one to one. It's not like, oh, let's create more podcast episodes and we will get more customers or let's do this type of thing on the podcast. I've always struggled with how do you put those in the mix? And like we're even dealing with this now, like for Exit 5, right? US writing on LinkedIn is the number one source of new members. However, if I only write about promotional posts to drive new members into exit 5, it just doesn't work like that. And I'm curious to hear your take on that.
Yeah, it's a great question. Right. So what you're really asking is there are things at the bottom of the funnel that have call to actions, like try it now, start a free trial, buy now, book a demo. And what about all those marketing strategies that aren't bottom of funnel, that are top of funnel, that are awareness focused, that are, you know, we would pull brand marketing awareness, whatever you want to call it, non direct response. All I'm saying is that good marketing, you know, Dave, your, you know, podcasts or your LinkedIn posts are going to appeal to me to want to go into exit 5 anyway, even if you don't put a call to action and a direct response format to it. And this is the mental barrier that we have to get, get across. And so in terms of your measurement strategy, here's how it works. You look at impressions or reach across every single channel over your historical time period. How many people are actually downloading and listening to your podcast? How many people are actually reading your LinkedIn posts? That becomes an input into the marketing mix model that I talked about. And so you don't have to guess and wait for a direct response, click on those pieces of content. Now I will add one more thing, which is this idea that you were just alluding to, that I will do more podcasts and therefore I will have more business. Well, of course not. Podcast itself is just an asset. The distribution and how many people are actually listening to the podcast is the input into the model. And that's where your unlock is going to be. If the same podcast is listened by 10 people or a thousand people or obviously that's going to have an impact on your inbound lead volume. Cool.
And just building on that, I think like being able to articulate where the podcast fits in your marketing strategy, it's like growing the number of people who might hear about us over time is going to increase in some number of exactly, you know, hand raisers. I used to always battle with our head of ops on this. He's like, well, how many demos do you think we're going to get from the podcast this year? I'm like, I don't know.
None.
We could, we could get none. That's not the goal of it. But we, we happen to get some from it.
Yeah, that's exactly right. Right. Like, what is the goal of the thing that you're doing and if it's not hand raisers, well, what is it? Right, and let's talk about that. And early on in my career, I struggled with this, just like you, Dave, because it was hard to say this is the goal because I didn't have a clear way of saying I can measure the impact on that metric. What I'm telling you now is you absolutely can measure the impact on that. And I will also tell you you're not going to get it right in one quarter. You got to give it time to experiment and figure out the distribution channels to get to the right ICP and hopefully have compelling content that then gets them inbound. So there's a multitude of factors and we try to simplify it in a bite sized way, but you really have to be able to talk about this intelligently with your peer group as a marketer.
All right, I just saw this one. I want to build on this. So Christine asks, when do you know it's time to cut losses on experiments versus waiting long enough to see an impact?
Oh, wow, experiments. I'll tell you, like my way of thinking about it. And this is the way of thinking about experiments. You define your hypothesis, your budget, your time period, and your expected or desired effect on your metric before you do anything. Right? So let that sink in. Right. It's like, what's the hypothesis? How long are you going to run this test? How much budget are you allocating on the test? And what is the expected lift in the metric that you care about? When you set those four things up right off the bat, then it's very clear at the end of the test period, you call it, did the experiment work or did it not work? And what you learned from it and you rinse and repeat. So it's not a subjective answer, it's an objective answer based on how you designed your experiment.
This question is from Zach. It would seem that how marketing is defined as well as how a business is structured is integral to how it's measured, particularly incrementality. Given that and the general nature of cross functional teams in B2B, do you see sales as a component of marketing, a partner to slash with marketing, or its own function? And how does that influence how you measure success?
Yeah, it's a great question. Sales is sales, marketing is marketing. These are two distinct and different things. So no one is not part of the other. Whichever way you slice and dice it. Now, you might have different reporting structures because you have a unicorn of a business leader who can think equally about marketing and sales, great. If you have that in your business and it makes sense for you to organize the team that way, I get it. I will also say that 90% of the cases, it's very hard to find that unicorn. So just keep that in mind. So I don't think about sales and marketing in this sort of unified way, contrary to popular belief. What I would say is go back to modeling your business realistically and I'm going to jump back and kind of put that slide up here. Right. Because if you are understanding how your business model works and what marketing is responsible for, then all your sales and marketing alignment issues fade away. If you know that marketing is driving hand raisers primarily that is the key performance indicator of your marketing team, then hey, why do you need a whole bunch more alignment between sales and marketing? And I'll just be very clear here. I hate the word qualified marketing. Qualified sales, qualified. Your customers are qualifying you. You are nobody to qualify your customers. Like, sorry, that's a very strong sort of statement. But I strongly believe that if you throw that word out of your vocabulary and focus on the true explicit intent of a prospect coming to your website, then you won't have the problem of figuring out how to get marketing and sales to work together. It's very clear. Got 20 people raising their hand and saying, give me a demo.
Cool. All right. Do you have any parting thoughts before we get out of here? Give you the mic.
Well, I appreciate that we had a fun little thing going here for the last 10 minutes. So folks who are still watching, we have a fun little game. So hopefully it'll work. We'll see. So super bowl just went by in the US So I apologize to everyone who's dialing in from outside of the U.S. but what do super bowl ads do? How do you measure their impact? Right there are these one of these really notorious but talked about things in advertising. So I thought it'd be fun. You know, I don't know if you all are Deadpool fans or not. I am. Love that movie and that character. And they had a pretty interesting ad. Right. Wolverine and Deadpool. So I'm curious if we had to take a poll in the chat, what do you think that ad did for Deadpool in terms of the effect it had on Deadpool? Any thoughts? Dave, what do you think? Huge impact.
Ticket sales, Huge impact. Give us the spoiler.
Okay, so this is a very basic big spike and then nothing, basically. Right? So if you look at just Deadpool searches on Google Trends before and after a Super bowl, there's a very minor impact. So if you think of this as a leading indicator, Right, Just people searching for Deadpool definitely had some impact, but if you don't follow that up with some sort of other ongoing campaign, you're going to realize that it didn't really do much. So that's Deadpool. I'm not saying don't advertise on the super bowl, but it's just an interesting way of looking at the business. I thought this ad was hilarious. I don't know if you thought that.
Okay, so let me. This. So I use this. Thanks to my wife, I have a proper skincare routine because she's seen me on video and she's like, bro, we got to fix you up little bit. So I got some Sarah V, among other things, and my daughter, who's 6, we watched a little bit of Super Bowl. She saw this commercial. She sees this on the counter. She said, hey, that's the lotion from the commercial. So there's at least one. One ROI measure right there.
Okay, there you go. There you go. They actually did some really interesting stuff, micro influencer stuff before super bowl and. Yeah, exactly, Natalie. The buildup and the lead up was fantastic. So what did that do? It actually had a, you know, I would say a better impact than the Deadpool one, but also not that sustained. So you can kind of see, if you zoom into Google Trends, you can go there and do that yourself. You'll see that the overall interest level did see spikes after the ad aired, but again, not a huge one. So, you know, there you go. State Farm. I don't know. I kind of like the ad and the throwback to the 90s with I forget the name of the movie that these two appeared in, but any takers on what it did to State Farm Twins? That's right, yes. So not much. Nothing happened. State Farm has a lot of organic searches happening all the time. So this little spike here on a Saturday. So their weekends are pretty dull in terms of people going to State Farm or searching for State Farm. So you had a spike, but that spike was Pretty much the same as all the other weekday spikes that they have. So that's what you get. So a couple more here. I thought by far the people who won super bowl this year, apart from the Chiefs, were Dunkin Donuts. I thought their advertisement was awesome. For people who don't know, they've been doing this Ben Affleck meme for like multiple years. And they're actually private equity owned, which means to get approval for a 20, $30 million advertising budget for super bowl, you really have to know what you're doing and be able to prove the impact that it's going to have. Check out what it did. I just searched for Dunkings, so not even Dunkin Donuts. And you can see that they've created a universe of Ben Affleck and Tom Brady and Matt and they can continue to leverage this over time. There was obviously no search mentions of dunkings and now it's showing up, which is pretty awesome. All right, last one. Temu. So I was surprised by how many times this ad showed up on Super Bowl. It was like they played it like six or seven times. I don't know about you, but I thought I was curious about what impact that would have. And the numbers won't do it justice, but there was a marked increase, a baseline level increase that you see before and after as a result of that. I don't know if that'll show up in sales and active users, but, you know, sometimes things that seem odd on the surface may actually, you know, have a pretty good impact if you know what you're doing. So check out Timo.
Okay, I still have no idea what, what this is. Is it a real website?
I have no idea.
No, you have no idea what Timo is? Oh, my God.
You got to shop like a billionaire. There was a lot of. There's a whole, they, they also wrote a whole wave of just like social media memes based on this, which is also, I think, an opportunity.
That's right. Okay, that's all we have. Connect with me on LinkedIn if you want to learn more about this type of stuff. I write about it, I talk about it, and then exit 5. So plug here for the community, go in there and let's have a conversation and a group chat about how you all can leverage some of this in your day to day.
Awesome. Thanks, Pranav. Thank you everybody for hanging out here today. This is a great session. We got more of these. We try to do one or two of these a month. Go and connect with Pranav.
On LinkedIn.
He is as responsive as he says, so hit him up if you have a follow up question. And he's also an active member in the Exit 5 community. So go in there, start a discussion about measurement. Otherwise I'm out of here. I'll see you all. Have a great rest of the day. Great rest of the week. I'll see you all inside of the community and on LinkedIn and everywhere else. All right, see you later.
See y' all.
Exit.
Today's episode is also brought to you by Paramark. It's July 2nd half of the year is here and hey, before you know it, 2026 planning and everything's gonna be here. But let's be real, most teams are still guessing when it comes to what's actually working in marketing today, which channels to double down on, which campaigns are worth running again or not and what's just noise, what's actually contributing to Pipeline and what's not. It's Messy. This is B2B marketing. And that's exactly where Paramark comes in. Paramark is a marketing attribution platform that shows you what's working and what's not so you know exactly where to invest your next doll marketing mix modeling and incrementality testing to give you a full picture of performance across every channel, tactic and region. And it's built by a marketer made for marketers. And right now they're hosting a special office hours on helping you with your second half of the year. Planning, forecasting and putting your best foot forward for the rest of this year and into 2026. It's not a sales pitch from them, but this is your chance to get real help from their experts that are at the intersection of marketing and planning. Bring your data, bring your questions, your roadmap and the Paramark team is going to help you figure out what's driving results, where to cut and where to invest moving forward. So stop guessing and you can plan smarter right now with the team at Paramark. But you got to grab an office hour spot. I highly recommend doing this. Pranav is awesome. The rest of their team is great. They totally get this space. You should go check them out. Go to paramark.com officehours that's paramark.com office hours.
More from Dave
Influencer Marketing, Podcasting Strategy, and Brand Driving Demand with Jess Cook (VP Marketing at Vector)
How to Use AI for Content Without Creating Slop with Eoin Clancy (VP Growth at Airops)
How to Stand Out in B2B Marketing (with Louis Grenier, Author of Stand the F*ck Out)