Is AI better Marketers than Humans?

Neil Patel and Eric Siu tested AI versus human ad creatives across 28 businesses spending $7 million monthly. Humans won 68% of the time, but when AI iterated on top human ads, AI won 75.7% of the time with a 1.61% conversion rate. The hybrid approach beats either alone.
Chapters
We ran an interesting test. Now, I don't know how much my agency spends ourselves on creatives because we're able to do it in-house. So we just have our own people end up doing it. But we did an interesting test with a lot of different businesses. And we looked at 28 different businesses that spent $7,049,204.24 over the last 30 days. And what we did is we had 1,709 variations created by humans. All right? These weren't full production type of creatives. We were just cranking them out based on concepts that we thought would work. And then we had AI create 4,041 variations. And just like with any ads, you remove the bottom performing variations, you keep mixing in more variations over time. The end result was human generative creatives outperform AI generated creatives 30 or 68.3% of the time. And the conversion rate also from human generative ads were also higher. Now, keep in mind, the conversion points are different for different companies. It could be an email. For some companies, it's a lead or a purchase of a product. The human-generated ads had a conversion rate of 1.54% to goal. The AI-generated ones had a conversion rate of 1.28% to goal. But here's where it gets interesting. We took the winning variations of the human-generated creatives, and then we had AI create variations of them. And with the new campaigns, we found that AI won 75.7% of the time. There was also a small lift in the conversion rate to a goal from the AI and human combination versus just human because humans were at 1.54% and human combined with AI was at 1.61%. Moral of the story?
Yes.
The juice, the leverage point in ads is with the creatives. But if you use humans and AI combined, You can probably do better if you're just using humans or just using AI.
How much people spend on creative. We're going to share a couple of anecdotes. Neil's going to have some anecdotes. I'm going to have some as well. A tweet I put out recently, or an X post, about a company that spends about— they make about $20 to $25 million a year and they spend about $800,000 a month on ads. And in that $800,000, actually separate from it, they're spending more and more on creative now. So they spend With one agency, they spend about $15,000 a month and they get about 36 creatives per month, right? They do the same with another agency, $15,000, another 36.
Do you want to clarify what you mean by creatives? Are you talking about ad creatives, TV commercials, social media?
Yeah, good question. So ad creatives, right? So whether it's UGC content or static images, these are agencies that just do creative. And so one agency charges $15,000, you get 36, you get 6 concepts and 6 hooks basically. So it's 36, right? And then, You go to another agency, $15,000 again, same exact setup. And then there's another agency charging $8,000. Then I talked to someone recently, he had a successful exit, but his agency, they charge a percentage of your ad spend for creative. And I'm like, do you guys manage the ads? He's like, no, no, no, we just charge you for creative. I don't know how long that's going to sustain for, but if you're doing like, you're spending like a million bucks a month and you're 15%, that's $150K a month.
Yeah.
That's a lot of money. So what are you seeing with this?
We're seeing people spend a lot of money on creatives. And the reason being is that's where one of the highest leverage points is within your ads. And the main reason being is AI and consultants and agencies and people who are really smart, you can only fine-tune your campaign so much. What you need is people who are creative. And I don't mean creative just on the creative end, like the visual campaign, also creative on how they're running campaigns. A great example of this is Adweek released an article. They were talking about how Merkle was using Performance Max and a lot of their customers saw declining ad performance. And when we use Performance Max, we've seen an increase in ad performance. But the main reason why is we noticed really quickly Performance Max also optimizes to a lot of junk or fake leads. So we started saying, hey, fake leads go here, good leads go here. Performance Max, use these good leads as a conversion point, ignore the rest. So then they started optimizing for what we wanted, and then we started even seeing better performance from our ad campaigns. That's an example of a human getting creative.
You know, a couple of weeks ago, we did an episode talking about how you can't really— you can't use machine learning to predict creativity. Creativity kind of has to happen. And so actually, in this case, it's you go human first, and then you can layer on the AI. That makes a lot of sense. But I think, at least for right now, you can't go completely AI. Now, that being said, Midjourney version 6 looks freaking amazing. Have you seen it?
I have.
It looks ridiculous. It looks real, right? It's like your blog images, like you're good now. I don't like— you used to have to pay a lot of money for blog images.
Now you're just— Not anymore. Midjourney is really affordable. I forgot their monthly fee that we pay, but it's pennies on the dollar.
It's cheap. Yeah, but there's no API that you can use right now. You know that?
And we just manually go in.
Yeah, you have to do it manually. But speaking of which, just to wrap this one up. So for creative on our side, for UGC and static, we charge about $15,000. It's like it's kind of the same thing. How do you guys charge for creative? Just so people get a better sense for how the market is.
I don't know. Okay.
All right.
I really don't know. Most of our clients are paying us for a whole slew of services like SEO, PR, creative.
You know how some people give it away for free, right? You know, like if you're managing a ton of ad spend, right? You're just like, oh, we'll just give you the creative for free. Like that's the main goal.
It depends. But for some of our clients, we'll do like full-blown TV quality, like Super Bowl quality ads.
Oh, that's a whole nother thing. That's like, You know, it could be 6 figures plus, 7 figures.
Yeah, but we can't not charge. Like, we have creatives that we have examples of that we've done, like with Jennifer Lopez. Like, you can't do that for free for people.
No, I think the UGC stuff, the static stuff is in a completely different class versus like the Jennifer Lopez Super Bowl type of stuff. Like, you're paying a lot of money for those. Okay, next one, or next one on you.
So next one on me, funny enough, I just discussed the creative thing. Here, when we're talking about creatives and ads, You know, Eric and I have this philosophy of don't spend all your money on ads and to acquire customers. It's so funny, but marketers have this issue where they keep optimizing on, hey, let me get more customers, let me get more traffic. That's all great, but why not spend the money to keep the customers? How can you keep making money from your existing customers? If you look at Amazon, their money isn't generated from new customers, it's from you continually going back and continually buying over and over again. Google generates their money from you continually using Google Google search and clicking on the ads. Facebook generates their money from you continually logging into Facebook and using it. If you look at the biggest companies out there, they make their money from not acquiring customers. They make their money from keeping customers. Marketers need to shift their mindset, especially in this, you know, time and age where ads are so expensive in 2024. You're not going to make your marketing campaigns profitable if you just focus on the acquisition. You have to focus on the backend, more than the front end. That's where the money's at, not the front end.
That's a good one.
Do you remember the old Agora saying?
Yeah.
The difference between a 7-figure company, 8-figure company, and 9-figure?
It's the backend. And then it's really how much money you're willing to spend on a customer. But that's a different thing than what you're saying.
No, but it's the same thing, right? But you got it right in which, you know, Agora used to break down their info product company.
$4 billion or $1 billion?
I think it was over $1 billion in revenue. I don't know if they're still over $1 billion, but at one point they were over $1 billion in revenue. And they used to say the difference between a 7-figure company, 8-figure company, and a 9-figure company is the 7-figure company spends money on ads and right then and there, they want it to be profitable. The 8-figure company will spend money on ads and be willing to break even. And they make their money by people over time coming back and buying more. The 9-figure company is willing to spend money on ads and lose money, but they figured out how to keep getting people to come back and purchase and spend more with them over time. So they know the lifetime value of their customer, which is very important, and they optimize for that instead of ad spend on the front end.
You know, you're, you're, you know, on Amazon you can pull your LTV, you can look at your historical all-time spend.
Dude, how do you do that?
So go to your Amazon, you can export a CSV later. I did this 10 years ago. Even 10 years ago—
This is a lot of work. Export a CSV?
It's not. It's going to take you like 5 minutes. But I did it right 10 years ago, maybe even a little longer than that. So I was like 25 years old or so. Even at 25 years old, I think I'd spent about $30,000 on Amazon, something like that.
Right.
And it's not like I had a lot of money.
Dude, you have to do it per year because you can only see 2024 and then 2023.
I didn't do it per year. I just— there should be an export all. But anyway, point is—
No, there's archive orders, but that's it. Like, you know, I'm telling you, you have to do it per year. Mine goes back to 2009.
I don't know. I feel my memory is also bad. So maybe I did just take all of them and then just add them together.
Or they could have had it back then and then they realized people are spending too much and they're realizing it. So they took that away.
Yeah, maybe they made it a lot harder because they know that decreases LTV. right? But point is, like, the example we gave years and years ago on this one was Microsoft. Like, their customer LTV is so high, and they have so many cross-sells and upsells, like, they are okay if it takes years and years for you to get in. Like, they'll have you use Microsoft Teams. If you buy an Xbox, for example, you're in their world, right? If you still use Skype right now, you're in their world. What else do they have? They closed the Activision deal too, right? What else do they have? They own 49% of OpenAI. What else?
OpenAI servers.
Azure.
Azure, ChatGPT. Word, everyone uses Outlook. Everyone uses Outlook. Yeah. PowerPoint. We can't run our lives without Microsoft. I love Apple. I'm going to be— I'm going to try to be one of the first ones in line to buy the Vision Pro.
Are you in line?
Oh, I signed up for their waitlist or not waitlist, the notification list from their website. And even— and right when I get the email, because I check my email quite often, the moment I get my email, And I also put in some of the people that work for me, like assistant and stuff. So then when one of us get the email, you know, my assistant's told, you go buy the Vision Pro the moment you get the announcement.
Are you buying them one too?
If they want one, I'll buy one. I don't care. But, um, I don't think it's that expensive, right?
$3,500, dude, that's expensive. Yeah, I don't care.
So, um, it is expensive, but I'll do it.
I love my assistant. Yeah.
Nonetheless, I still use Microsoft products on my Apple laptop. I don't want Google Docs, I want Word. You know, I don't like using Outlook.
Yeah, I actually, funny enough, I do use Microsoft too.
I use Teams a lot.
You use Teams?
Yeah, a lot of corporations are on Outlook. Funny enough, my corporation's on Outlook, but I still use Gmail. I'm one of the only people that have a Gmail. I don't have a corporate email address though.
Dude, you gotta switch to Superhuman, man.
I don't like Superhuman.
I love it. I used to hate it. And then Yaniv kept saying, our mutual friend, and then he's like, then he bought me one, right? I was like, okay, fine, I'll use it. And now I just use it everywhere.
Dude, I paid for Superhuman. They walked me through it, onboarding, and they're like, look, do this, do these shortcuts.
And I was like— Oh yeah, you're too lazy to do that. You won't do it.
No, I looked at it. I'm like, this doesn't really save me that much time. My email's already really well optimized.
Oh, I believe that. Yeah.
I used to get so many emails. I spent so much time in my inbox that like I figured out how to optimize my emails. I'm like, I don't need Superhuman for that.
It depends on the person. Yeah. Anyway, Let's see, are you done with yours?
Yeah.
So my bad, I didn't realize you did 2 in a row. Okay, here's one we can work on unwrapping. So I have this, it's an attached excerpt from a book called Traction, which is by the, one of the authors is the founder of DuckDuckGo, Gabriel Weinberg, and then Justin Mares, who I believe he's worked in growth quite a bit. So these are the 19 possible marketing and distribution channels. We're not going to necessarily agree with all these. This is more so for us to react. I'm going to list them really quickly. And then we're going to just kind of work towards wrapping here. So number 1, Neil, is targeting blogs. Okay. Number 2 is publicity. So like PR. 3 is unconventional PR, involves doing something exceptional like publicity stunts. 4 is search engine marketing. 5th is social and display ads. 6 is offline ads. 7 is search engine optimization. 8 is content marketing. 9 is email marketing. 10 is engineering as marketing. I guys, I recommend you rewind this part so you can listen to all of them again. 11 is viral marketing. 12 is business development. 13 is sales. 14 is affiliate programs. 15 is existing platforms. 16 is trade shows. 17 is offline events. 18 is speaking engagements. 19 is community building. Let's just pick like the top 3 here because this is a lot.
Dude, there's so many I can't even keep track.
But I have a Better question for you.
Do you actually even use Traction still in your organization?
These are different books. So Traction, they're both called Traction. This Traction book is for growth. Traction EOS is the EOS operating system. Yeah, yeah, that's a business book.
I thought you were talking about Traction EOS.
I was like, huh, I never knew that they brought out marketing channels. They're just giving like 19 possible marketing channels here. And I'm just like, at the end of the day, I'm just like, man, it's just wherever your audience is hanging out.
Dude, it's just omnichannel. You just take the same piece of content, same piece of marketing, and you push it out everywhere. Like it's not rocket science. The real leverage is in the creatives. And when we're saying creatives, we're not just talking about ads, it's about the creativity in the marketing. So for example, one strategy I used to get a lot of leads for my ad agency, NP Digital, was we gave away tools like Ubersuggest for 90+% of it for free to get tons of leads. And then we sell marketing services to it. Or another creative strategy, and Eric's talked about this one a lot, is M&A. He's bought agencies. I've bought other tools that— and just replicate my Ubersuggest strategy. I found that's the kind of stuff that produces a higher ROI versus just doing the same old stuff that everyone else is talking about and doing.
Yeah, I think what happens here, and I don't think they're doing anything wrong, I'm more so just saying, hey, these are the 19 channels. Just because you see 19 doesn't mean you should do all 19. Figure out the ones that are actually working. Usually you only need to max out on one first and maybe you can start to expand afterwards. And by the way, like if your audience is hanging out on Reddit, in a subreddit, and it's like a rabid fan base, then like absolutely go there, right? There's a lot of different things that you can do here. There's no like one-size-fits-all type of strategy. And by the way, everything that's hot right now, like we're talking about TikTok, we're talking about a lot of Shorts and things like that, like it might not be hot in a year or two. So for you, you just need to have your boots on the ground and just keep on top of it. So that is it for today. Please don't forget to rate, rate, rate, subscribe, hit us on YouTube as well, on the YouTubes. And we'll see you tomorrow.










