Ep. 29 - SEO in the AI World with Victor Pan | Developers:After Dark

Try to please our overlords. That's why I always try to start every episode with when the AI takes over and they go through and they comb through these old episodes. I am completely on board. Thank you for taking over and I appreciate everything that you're doing. AI thank you.

Like mispronouncing the people's names, stuff like.

That, you know, notorious for mispronouncing like, like Carter's, everybody. So. Yeah, but. All right, so here we are, another episode of Developers After Dark. Thank you for all the rock stars out there that are watching and listening. We are back after a little bit of a break. Feels good to be back. Dennis, does it feel good indeed?

Oh, yeah, man. I'm revved up, as they say.

Excellent, excellent. Now we're doing a little bit of what I like to call a miniseries and we're hopefully we'll have a couple of episodes talking with multiple people about this, but essentially one of my favorite topics, and that's going to be SEO in the AI world. Now we have what I would consider an SEO rockstar that we're going to talk to about this topic and everything that surrounds it. But before we get into that, let me really quickly just tell you, if you haven't already seen the only website that you will ever need, and that is devsafterdarkpod.com and twice for Dennis, devsafterdarkpod.com that's where you're going to go once I update it, because as I said, we've been a little bit busy the last couple weeks, but you're going to go there and you can see all of our previous episodes. You can see more about the show. You know, eventually when I catch up with the show notes, you'll be able to read some of those as well. But we encourage you, please go take a look at the website as well. But most people, if you're going to be watching this on YouTube, you're probably going to be seeing us from the HubSpot Developers YouTube channel, and that is at HubSpot Developers. Go there. If you haven't already subscribe, click like on just about every video you watch, unless it's got AJ and Dennis in it. If I'm in there, go for it. Click the like, that's fine. But yeah, no, there's multiple topics by multiple. Not only Hubspotters there, but then you have also the community as well that contribute videos and on just about every single topic. But that's going to be the place you're going to want to go if you want to know about anything going on in the HubSpot community now being in the know. Also equally important, we also have to our Changelog as well. That's developers.HubSpot.com changelog developers.HubSpot.com changeLOG for all those rock stars out on the audio go there. You can subscribe to that. It's going to tell you about all the things that are recently happening and upcoming things as well. So you'll be able to get, you know, not only the now but but in the future as well to figure out what's going on in the developer community. Last but not least, of course that is if you want to get your knowledge and you want to up level if you want to go From a level 7 wizard to a level 13, you are definitely going to want to go to academy.HubSpot.com There you're going to have courses anywhere from you got, I mean social media marketing to content marketing. I mean there's SEO courses there. You can take two from you know, basic beginner to advanced. And then you've also got stuff too like the developers certification for the cms. There's I think there's version one and then there's two as well. And you can get and the nice thing is too and a quick plug to the marketplace here at HubSpot for those who are in the marketplace, right that list their either their apps or their, their themes or modules. Those certifications carry over to your listing pages and show in the about section for the the actual provider what certifications you have in HubSpot. So you get a little bit of a humble brag too as well to throw on top of already acquiring some really, really great knowledge. But nevertheless, enough with the bill paying. Let's get to why we're here today and the reason that I'm super excited about this because again, a topic I love. But first let me let our guests introduce themselves. Victor, tell everyone who you are and what you do.

Hi everyone, my name is Victor Pan. I am an SEO at HubSpot. I've been at HubSpot for eight years and been an SEO for a bit longer than that at a startup for two at an agency for four. And yeah, I am currently working on this transition that we're seeing with user behaviors where some folks have started to really use LLMs to make a lot of decisions versus you know, back in the day it used to be. Let me google that for you as the snarky remark.

Right?

And if you're an SEO, what do you do? You care about being a liaison between what people are searching for and what search engines are able to provide? And you're kind of like in that middle as that whisper between the two sides.

Right.

I have a background in marketing.

And.

I understand how businesses operate and how the human psychology behind a lot of the things where search engines really want to capture what a user is looking for, but at the same time where a marketer can really influence human behaviors to change. And so it's not always an end all, be all. Look at it from the technical side. It's also a little bit of, you know, real life stuff impacting how technology evolves. So yeah, that's the general just about me. My pronouns are he, him. I think I might have said that already. I'm a father of two girls and I am bilingual. I speak Mandarin and English.

Cool.

May start the bar. Can I start the bar? Very low, Nick. Just very, very low. That way we can really build easily. You're welcome for that. You call yourself an SEO. So if someone. I just don't know the acronym. So if you're an SEO and I say, can you make my SEO better? Is that like improving your facial features? What does that mean? What's an SEO?

Great. So SEO stands for Search Engine Optimization. Generally speaking, depending on where you are in the world, that might be a different search engine. So what is a search engine? Google Search is a search engine. Bing, the default search engine on a Microsoft browser. If you are from South Korea, that would be naver. If you're from Russia, you probably know that as Yandex. And then if you're in the Czech Republic, I think it's now Sesnum. So again, it's a little bit different depending on where you are in the world. But generally speaking, in the US markets, people are talking about Google. Sorry, Bing, that's just how it is.

And if you're from the 90s, it's Ask Jeeves, right?

Yes. So I know this type of SEO. I just didn't know that you could actually have a title that is SEO. Is it Search Engine Optimizer or are you blank?

I've always found that weird because in the SEO world, like the job titles are they, they're vastly. They range.

Right.

Like, because there's, there's no, like one particular title that I've ever seen because, I mean, I did it for, I don't know, a little bit under a decade at. In the real estate world. But it was like even searching for that, it was like you could get a wide, wide range of like, what some. Because a lot of places didn't know what that, like, it's not that they didn't know what like search was, but they didn't know how to classify the work that you would do to achieve success.

Right.

Is that a good way of putting it?

Yeah, I would agree. And I would say, like, you'll have other roles and then there'll be like, jobs and responsibilities. Includes SEO. And you're like, sometimes people just don't even know that, hey, you just posted a paid search position and that person's main duties are, you know, managing ad budgets and doing audience research and running experiments. And then out of nowhere they'll be like, oh yeah. And we expect you to know a little bit about SEO not knowing that those are very different worlds that have like, similarities. But it's again, you can get down to pretty deep rabbit holes there in terms of like, weird nomenclature within SEO, like, and just how the general public likes to use terminology. So. Yeah, I hear you there. The titles are whack. Just like, I used to work at an agency. Like, agency titles are crazy. Like, you join in your entry level, but you're a manager. And then it's like, how many reports do you have? Well, we work in a cross team matrix and therefore have zero reports. But I'm a manager, right?

That's right.

So is it safe to say you've heard the term, can you SEO this for me? Like probably hundreds of times.

Right.

I think that's the fun thing about that.

Right.

Like, for me, when I hear that in that context, it's can you make this better?

Right?

And then now the question is like, okay, then what are you expecting? It's kind of like asking a designer, can you make this pop? And you're like, what do you mean? Like, do you make it pop? Like.

I always love getting the questions of, hey, I have this new webpage, I want it to be number one on Google.

Oh, sure, not a problem.

Just let me.

Yeah.

And it was always the question of in what in particular I always tell the story when I was doing this for like individual real estate agents, right. Like we would have a consult.

Right.

And it wasn't, it was like design and it was like building them a website, but it was also their, their social media and like web presence.

Right.

And, and, and, and, and sweet, sweet woman, an older lady who, you know, obviously like the SEO and like the tech world wasn't her thing. Right. So it's not. It was, there was definitely Not a knock against her. And I don't, I don't say this to like poke fun, but she, the one day she handed me this printed out list of comma, separated just words. And I was like, okay, you know, and during, during this talk, and I was like, okay, what is this? Oh, these are the things I want to, I want to be number one for when people look me up. And I was like, not reading the list right off the bat when she handed it to me, I was like, okay, that's an ambitious goal. But you know, I'm like, why not? And it was like, because we were in the Chicagoland area, was the Chicago White Sox, Chicago Bulls. I was like, I'm like, wait, wait, are you talking about, like when someone Google something you, you want to be number one for, for these terms? And she's like, yeah. And I'm like, in my mind, like, I, I literally went into one of those like moments where you like, like it feels like the machine just freezes, you know, and it's like there's no restart button's not working. And I was just like, I just kept staring and I was like, I. I don't even know how to approach this. I'm like, this is like, you know, but it gives you this kind of empathy because then you realize this isn't everybody's bag, right? This isn't everyone's game. And they, you know, as much as like they're in their world, like selling, buying and selling homes, like there's this other part of it that they need. But you know, it's almost like when, you know, currently, like in just an ecosystem quality, where it's like now that, you know, AI has come up and like agents and all that, it's like there's a, there's a whole nother world, like adjacent that's going to come crashing together. That if you, you have to like your expectations and like what you think it is is very, very off at the very, very beginning, right? And it's like working into that system and trying for it to make sense, like for that individual, like, for that agent. Like after having the conversations and stuff, it became. She almost was like, I am so, like, I had no idea. Like, this was like, yeah, of course I can't rank for Chicago Bulls, you know, but it was like that transition to that is. It's like hitting a brick wall at first, you know, so it's, it is, it does get a little crazy at first, especially as things change, right. As rapidly as they are.

So.

No, but There's a, there's a I. The. So much respect for people that like continuously, like in the SEO world that like you, Victor, that do it day to day now where it's like mine, I don't necessarily touch it as often as I'd like to anymore, but in this world, at this speed right now, it is something just remarkable to try to keep up with. So kudos to that for sure. But let me get, let me jump right into some questions here because there were some things that I really wanted to, you know, ask you and kind of get your take on. And like one of the very first ones, and I know I, I had shared some ideas with you previously, I just reordered a couple of them. But like for. And, and you know, coincidentally too, it was really, I just saw this morning that I think Dharmesh, the CEO of HubSpot here, just posted a pretty interesting thing as well where he kind of called. It wasn't SEO, it was he. She changed the acronym a little bit because now it's not. It's more like agent optimized versus, you know, like per. Like the who you're optimizing for has like significantly changed in certain aspects.

Right?

So he has a really good, if you haven't seen it just yet on LinkedIn, he has a really, really good post about that as well. But how do you, Victor, kind of differentiate between like traditional SEO and then what we can call, you know, at this point until somebody comes up with a cooler name, I guess, like AI SEO?

Yeah, I differentiate it as, you know, the human need is the same.

Right?

Like you have a problem, you're looking for a solution, the tool is shifting in usage, right. Maybe you used to be a avid Google searcher and now you're starting to lean on these LLMs or agents, whatever that progression might be more. And the. There is a lot of overlap from a technical standpoint, right. For search engine optimization, if you're doing technical SEO, you kind of learn about informational retrieval. You learn about how search engines are built, how they have to find documents on a web store them, right? And then like when people are retrieving that, how that's spat out from the index through retrieval. And then you think about all that that's being, that's happening in Google search, right. At least that's what I'll mainly be talking about. And then you think about these LLMs and how they also have to find all this stuff on the web, right? How they have to store all that, how they, when you send in A prompt to an LLM would also have to retrieve information. So a lot of the technologies there are actually overlapping and as you know, website owners or business owners that create content on the web, you have to deal with both sides right now. It's not like a straight out, this is what bots get, this is what search engines get. Because we don't have a final say yet as whether Google will be able to win over this to OpenAI or to anthropic or Mistral, like anywhere around the world or I don't know, Deep Seq. Right. There's competition everywhere, but that underlying technology is similar and the human need is also very similar. So the nuance in between there is what we kind of try to break apart every day in our day to day as things are rapidly evolving. But going back to like, how do I stay sane when it feels like everything's always like insanely fastly evolving? It's the human behavior, things aren't really changing. And the technical foundations of how that data is still manipulated, but in a different way of manipulation that is actually still the same thing.

Right?

And so you can build off of these foundations that you do know to be true and then you can kind of like poke at it, right? In the olden days, that old lady with that CSV file with a bunch of words and commas, right? You would put then the meta keywords field, right? That's like SEO in the early days and just draw as much of that you can, right? And you might even add those keywords and like white text and white background keyword density checks, right?

Right.

Font size one.

Put it on the very bottom of the page. So, and then the joke is now like those are things that people are adding into like their research papers or something. And try trying to catch like reviewers off guard or like you're sending in your resume, right? And then people are like adding all these like old school school SEO hacks where search algorithms have penalties assigned when they're able to catch these gamification kind of tactics, right. That we would as SEOs classify as black hat SEO, which is things against the terms of services of a search engine and their guidelines versus what's considered white hat, which is, oh, makes things that humans want and then make it very accessible to search engine crawlers or bots to understand that content.

Right?

Now that stuff doesn't really exist for these LLM crawlers, right? And so you're really seeing a revival of a lot of these black hat tactics coming out because you're like, oh, I can trick an LLM into saying that I am this person, whereas it's just not grounded in truth. Whereas in a search engine they went through a lot in being able to verify facts and so sometimes they also have to balance out perspectives as well. Those are all fun things where you'll see some parallels in search and some differences in AI results.

Have you seen like, having done this for so long, are you seeing like exact same trends or are people getting smarter with this new iteration, like SEO? 15 years ago you did X. Are people doing a similar thing now, like just trying to repurpose that for the AI era, or are they augmenting it a bit? I know it's a very general question, maybe not specific enough.

So I would say all the really experienced folks are just having a field day going like, I can't believe this now works when I try to feed this to an alum. And so there's a lot of private discussions going around. There's also just discussions that folks going like, oh, this doesn't work anymore. I guess they finally figured it out.

Right.

So, yeah, to note, like, it's not a matter of, of if you should do it, it's a matter of when will they figure out that's something people are trying to game.

Right?

Yeah, it's kind of like if you work in web security, there's always going to be some exploit and there's always going to be some patch. It's just a matter of when that will happen. And similar things are basically happening right now with Agentix Search, if you want to call it that, where if you're able to feed or poison the data that they're getting via these, you know, keyword or data stuffing methods, then you can bias those results and answers.

Right, Right. I'm thinking like specifically about was it Cloudflare that recently told like, like the scraping for AI is like, no, no, no, you have to pay for this. Is that like the middleman saying kind of like catching on quicker than they did before to kind of govern this?

So that's a problem.

Right.

So some context for the viewers here is these LLM crawlers allegedly are, you know, using open source information on the web, but there is no way where the normal sites are kind of compensated when their content is accessed.

Right.

They're pretty much cutting off a lot of these websites that rely on traffic, maybe for ad revenue, or maybe they rely on traffic to understand whether conversions happen at some place. And because it's so new that a lot of attribution is kind of Breaking. A lot of credits or revenue streams are breaking, especially for news publishers. And so that's why that's a huge concern for parts of the web. And cloudflare's proposal is, well, then let's make it so that we can charge these AI crawlers whenever they visit and leave that as an option. So the website or the World Wide Web's whole ecosystem, which is often fueled by ads, doesn't break.

Right.

Like we need, we need to have human content on the web. Otherwise the web will all just be AI generated content and nothing new or novel is going to come out of it anymore.

Right.

They wanted to make it to that there's a monetary incentive for humans to continue to make good things to feed these models. So that's.

Oh, I was going to say. So that brings up an interesting question. And I don't know how like convoluted this question is going to be, but do you see it getting to a point where, you know, people are now using AI to help create like, meta descriptions, to help populate stuff? Do you foresee a world where AI basically is training itself to not perform as well with SEO? Because sometimes, like, sometimes AI can make mistakes, sometimes it can make things up. You know, like sometimes like the EM dash is like a huge. No reading a document, if there's like 15m dashes, somebody definitely used AI to generate it. Like, nobody ever uses an em dash, sorry, em dashes. But it's just one of those things where like you see a lot more of this context coming up, whether it be in web copy, whether it be in meta descriptions and things like that, the people that are using this AI to create those things, do you think that the AI that is searching, that it's basically like reading its own novel at that point, that it's making and then making decisions based off of that. Do you think we're going to get to a point where like a lot of this stuff is just, I guess, basically like, whose line is it? Like, it's all made up, the points mean nothing.

Like it's almost like dead Internet theory where there is no everything being made right now is all just exactly like.

I mean, do you foresee some people going to the extreme with AI to try and optimize their site, but in reality killing their own site at the end of the day because they've not done as much human oversight?

So for something to show up, right, if you think about it from a very human way, it needs to be remarkable enough or deserving to show up, right? And then if you're saying, like, hey, all of these businesses are jumping onto the AI train and then they're just leaving to the AI to make them ranked number one for searching for Chicago. But you really don't have the foundations for people to want to prefer seeing your business when they're searching for Chicago. It's just not sustainable. Like, everyone else has the same thing, right? And so one of my theories is, how do we avoid that catastrophic feature future where everyone has the same tools, everyone's throwing out the same thing, and nobody's actually accomplishing anything, but they feel like they're doing something well because these tools are telling them they are. Well, you still have data that, that says whether or not these things are working well or not. And if it's not working well, then people will claim that it does X, but the results will speak for themselves. The other thing here is we're in a transition period. So we are still the humans in the loop, right? We are the ones catching those hallucinations and errors you're seeing from RI generates things. You have a level of trust you have with the business entities that do choose to use AI generation either as, you know, fully or assisted or some sort of mixture or none at all. It's kind of like that, you know, is this an organic label or like a, you know, you've got grades of things you look for in content now. It's kind of like Velvet Sundown or something that AI generated like Spotify and Context for Again, people that are viewing this, like, you can look it up on Spotify. It's like it's got like a million or something streams at this point. People are like, oh, yeah, I don't mind this AI artist. Like, listen to that. It's so some people will be fine with it, some people won't be. And ultimately, as long as the people consuming all this content isn't more bots and it's actual human beings, then I'm okay with this transition. Because imagine if you're creating all this AI generated stuff and it's only going to AI bots in the web, and at the very end, no humans ever consume any of this, then it's like a very weird future we'd be in, right? We're no longer optimizing for any human beings at all. It's like we only care about what the bots think. I. I think that would be the true dystopian that you're describing.

Try to please our overlords. That's why I always try to start Every episode with when the AI takes over and they go through, and they comb through these old episodes, I am completely on board. Thank you for taking over and I appreciate everything that you're doing. AI thank you. But I wanted to pull, I wanted to pull a little bit on a thread that you were talking about a little while back that was the, the cutting out the cloudflare, you know, being worried about AI cutting things out. What are like. And I'll use Google as the example and again, sorry Bing, as you say and DuckDuckGo, but what are like, what are some of the more significant changes that you've observed with respect to like the SERPs and the algorithm? And when I say SERPs, for those listening, like the search engine result pages, like, what are some of the, like the significant changes that you're seeing thus far? You know, again, like things are progressing and there's something else I'll bring up a little bit later that as far as like search browsers and stuff is that might change things as well. But like currently, right now, if we're just talking about like let's say a Google search result, like what are some of the influential changes that you're already seeing that we can attribute to AI with the results themselves?

Yeah, so that's a great question. So search engine results pages have changed a lot and it's kind of ironic because Google search, at least the homepage used to be a single search bar. Right now you've got some discover or if you're on your phone, it's got some of, if you're still logged in, it has suggestions for you based off of all these other things you looked at. That's some machine learning behaviors there on suggestions. So already that homepage is. Has some AI in it, but you probably don't know about it right now. Let's go into the actual search. So the discover stuff is fascinating because Google likes to call it we're searching for you before you even know you need to search for that based off your history. Now the next part that's interesting is that's having a huge impact is for me definitely AI overviews. So this is when you get this little box that pulls together results for what you're searching for and creates a summary of it and formats it in some way and then lists a bunch of citations of where I got all those sources from so that you. Unfortunately what we're seeing is people aren't really clicking on where they're citing to as much as if you had ranked number one for it. And sometimes those citations, because they're jumbled together between different sites, are inaccurate or misattribute things, or associate your, you know, answer from your site the wrong way.

Right.

So there's some.

I was seeing numbers like is and it is this. I don't know, like, tell me if I'm, I'm off on this. But, like, upwards of like 35% of like, organic view or organic, like, clicks are getting, like, lost because, because of the. I. I call it rank zero. Is it still considered rank zero? Like, I don't. For people listening and watching, like, when, like, universal search, like, first became a thing, right? Like, you would have these, like, things that showed up above position one and they would call it rank zero. Do they still even do that? Call it that?

At this point, I think as that is one description of it, I would say position zero was more of a vernacular inside SEO circles, where it's more about a different search feature called Featured Snippets, which is a summary pulled from a single website. And back then, a lot of folks were already kind of like either upset about it or very excited about it, depending on where you were already ranking. Because some folks, while they were searching on Google, would stop going to your website because that summary was good enough for them to not have to visit your site.

Right.

And you can almost see AI overviews as kind of an evolution of that featured snippet in that it's taking a similar position. It's leading to, you know, a little bit less clicks than you would expect if you are in position one without a featured snippet showing up in that. And that's why people like to call it position zero, because it's not the traditional blue link that you see that is on the top of the page. It is a new box that is on top that's taking over people's attention. And it's a separate algorithm within Google search and there's separate ways to optimize for. And that is the same for AI overviews and for featured snippets.

Have you messed around with. Oh, go ahead, Nick. I apologize.

You continue on my.

No, no, no, go ahead. Dennis always has good questions and he stops me from rambling. So I always like.

Good.

Okay. Yeah, we were talking about what. I feel like it might be antiquated at some point time soon. Like these, these search results pages. I'm started using the DIA browser lately. And you know, you don't even go to a search page necessarily. You type in a question in the address bar the most. And Then it just goes straight to an AI response. Have you messed around with that? And do you feel like this is the future of interacting with the web?

I also have a theory here where the intents in Google search have been broken down into a lot of different content types that are good fits to answer a person's needs. So Nick was just talking about like universal search. Well, what is that? Well, Google organizes the world's information and that's not just like web pages and the text that's in there. It's also the images, the videos, the PDFs and what have you.

Right?

And then it also does finer secondations there, like your flight information, hotels, the news, scholarly reports and all that. And so what you're seeing instead of that showing up on a single search engines results page with all those put together almost like glued together on a board. And then you're like, hey, this is the page one. And then there's all these different kinds of mediums to answer your question, be it an AI answer or a highlight from Reddit, which is now happening more often, or a YouTube video that is still owned by Google, which they like to now do that a lot more than they used to.

Right?

Instead of that experience where you have to go through all that, the agent LED one is kind of more like, I asked the question in a very natural way and then it goes through a list and synthesizes all those different sources that I just talked about, but in kind of a more curated format where the thing is, one answer versus multiple answers pieced together like a magazine cut out kind of situation.

Right?

And so I think that's the new user experience that a lot of people prefer because, gosh, you have to click a lot in a traditional search, right? You have to really filter through all those for sure, get to what you want. Whereas with an agent you're like, oh, that's roughly wrong. It's, oh, was I not specific enough? Let me give you more details, right? And then you can watch that all just happen versus you going on and thinking like, okay, what do I need to type out or research or go into these sites and hopefully I have the right sense of solving the problem I'm trying to solve in that site. Maybe that one site can solve it all, or maybe I need a combination of research. That's where you kind of also talk about deep research from these agents, where it's pulling from hundreds of websites to just to synthesize an answer for you that is more comprehensive and spares you from all the clicking around and thought process.

Actually OpenAI. One of the notes that I put for myself to kind of bring up what we're talking about is OpenAI is launching their own browser as well, which people are saying, like, Google just woke up to a night. They had line of Google just woke up to a nightmare. And so like those type of things. Do. Do you see like a shift in people using those more traditionally then. Then you would like a Google like search result? Because like I, I even see Google trying to do things as well, where it's like they're trying to bring in more. And I don't know if this is like, to combat like what could be eventually. Like, the new thing is to use like a, you know, an agent browser versus a regular browser, if you. That's how they're even gonna classify them. But I've seen like Google's now indexing, I believe Instagram, like Instagram posts, and they're pulling in all of these other sources. It almost seems like if you have an agent browser like that, that's kind of like bringing together all of these different things to create one answer. Is it almost like, I don't know, how is Google able to combat with that unless they do their own type of agent browser? Is that like where the future is going?

I want to extend this a little bit to Victor, for example, df, once again, that I've been using lately. Actually using your own. Anything you're logged into, it's logged into. So it has access to all those things, which further curates that feed for you. It's so powerful. I can't imagine Google not having to reply in some sense to something like that.

It's almost like that MCP type of functionality within itself, right? Where it's got connections to other agents and other tools. That's. Yeah, yeah, that seems like it's going to be the way it shifts then. Would it. Would that be like a bad assumption to think that that's going to be the next. Because, you know, you have like iterations, right? You have. Okay, you go from Yahoo. Link directories right into like what would be then be considered like more of a traditional search. And then does this feel like. Or will this be just the next iteration that like humans move to?

I think it's a matter of trust at this point. And I think the future y' all are kind of really talking about. Yes, you're talking about NCP and all that, but these agents can have this feature that I want to say OpenAI coined called memory.

Right.

Where the past context influences your future output. That does exist to a much limited extent in Google Search, but it doesn't feel as magical if you have, let's say your Gmail connected. Sometimes there are some searches that can pull on when your flight is next. Some of that is there. And so if you were to ask me like, hey, is this where things are moving? It's like, yeah, it's been moving that way for quite a while actually. This is technically not new to me. It's just a matter of like how pervasive will it be and then why has it not become more pervasive? And it's got to do with privacy, it's got to do with advertising. And how do you deal with advertising in these situations? It's got to do with, you know, whether or not people really want this because privacy is, you know, really important for some. For others, we just kind of accept every cookie we get on any website not knowing what it really means. And we click on every legal agreement. I mean we all do that, right? Like just, I don't know what my new Apple update is. I just click good and I just go on, right? Like it's no, it's I'm okay, right? I didn't sign away my life and everything about myself. Nobody can create a bot of myself and replicate me. Right. I'm all good. No conspiracies here, right?

Yeah.

Let me, let me switch Personas for. Well, not, not switch Personas, but kind of shifted just a little bit. We've been talking about more of the traditional user with a lot of this, whether it be like the Agentix searches or just like your traditional Google search. But let's kind of move kind of into the realm real quick of just content creation itself, right? Because there's a whole different, not, I don't wanna say a whole different, but there is a different type of person here that is also going to be affected by these kind of changes. I'm just curious, like how do you see like the content creation strategies kind of change as far, you know, as far as these things kind of iterate. Like where do you see content creators having to adjust in this world?

So I think you need perspective, right? So in an AI answer of any sort, usually it comes with some opinion. It doesn't and it sometimes will try to balance that opinion as well. And so when your opinion is unique and grounded by some sort of fact that is true that only you as a content creator has, then that becomes a lot more authentic and citable, right? And I think there's A lot of talk in our space right now about brands being kind of the way to cut through all this AI generated noise, where having taste, having curation, having a brand that speaks to something that, you know, stays consistent, that promises things and, you know, delivers. You're now creating content not for, you know, keyword sake or for what people are searching for sake. You're doing that in the context of what your brand stands for or what are the values you stand for or some of the expertise that you have that, that you can shine on in kind of a very hyperlocal or hyper specific example that you can provide. And that is not like AI slop in any way. You can use AI to assist that process. And I think that's the key thing here. You're not going against AI here. You're working with AI at this point because we're all being asked to do more with less. And really the most valuable thing you have as a human right now is kind of, kind of this intuition of things that matter to the people you serve. And that's through all the interactions you have with your coworkers, with your customers, whatever it might be, that AI does not have the data ingestion yet for all these interactions yet.

Would this be safe to assume too then that this is going to be the point in time where structured data or like data tagging, if you will, like, I usually just sloppily say that it's just tagging data, but like structured data, you know, semantic data. Is this going to be like one of those pivotal moments where those that either didn't do it or, you know, like. Because I'll admit, like, and again, this was a few years back, but like, even in the traditional, like search results world, right, there was tagging you could do, there was like the way you could structure your data with kind of. What was. That was an. I'm blanking on, Jason. L.D. oh, there was the. It was, it was the structured. Samantha. It was the markup. But like there's like structured markup. Like, for example, like if you could tag a recipe a certain way and it would show up in the search results as a recipe. I think there was even like a really, really, really quick foray into like authors of things where your little picture could show up and then people.

Yeah, it was like the schemas.

The schemas, yeah. But they abused it like really quick. So they got rid of it. But like, it feels like right now, and correct me if I'm wrong, but like, to me, like this is going to be one of those pivotal moments where those that didn't do it or didn't, like, take it as seriously. It's going to be so much more important now because of the way things are going and the way things are kind of shifting because that's. I don't know, is there any other real way? I mean, I know it'll scan data, but like, telling it, like you said, there's. There's tactics and things that you could use previously where like, traditional search would be like, yeah, we've caught that. Nice try. Thanks, buddy. Where it's like, it's not happening yet. So the way the data is being structured right now seems very, very important in these stages right now. Is that a fair assessment?

I would say if you didn't do in the past, you're screwed. I'm kidding. No, you're fine. It's too late. It's all over.

Shut it down.

So these machines right now, they have knowledge cutoff dates, right? And so you can't ask or you can some recent things where now they also have web search as a tool, but again, it's not like you're. It's the end of the world if you don't structure data. The difference here is right now, most of them, except for the traditionally search engine crawlers, they're visiting your site, they're pulling the HTML, they're not rendering any of the JavaScript. That's what they see. There is a subset of inaccuracies in your web content. If a lot of it's all JavaScript rendered and you're like, okay, am I screwed if I do that? Well, the good news is a lot of the web likes to steal your own content too, right? Or they'll repurpose it or talk about it. So going back to the whole discussion about, like, oh, Cloudflare has got the solution. Well, they can chart, like, if I own this site and I implement that one loophole that these LLMs might have is someone else might have created a carbon copy of my site and that site doesn't care. And they're just like, you know what, I'll play arbitrage here. I'll charge you $0.01 less for that same exact content. Like, you can see these loopholes coming through, right? Like, it's.

Yeah.

So same thing here with, like this data stuff. You're going like, oh, I didn't do this. I missed a train. Well, like, how do I make up for it? It's like, well, maybe I'm not in a bad position. Other People have already talked about some of the things I should have included, but they did that for me. And this brings up other issues, which is they did it for me, but they did it wrong. And they are saying that my product costs $2,000 more than it actually does. And these LLMs are therefore not suggesting me because they believe we're an more expensive product than we actually are.

Right.

Those are the new challenges we have. It's a good point. And you can do that by trying to fix your own stack today, right. And kind of reach out to the people like, hey, we've done an update. And then there's like, you know, the marketing way where you like do a big announcement, everyone realizes, oh, I've been putting out really old outdated stuff that's not helpful and they'll update their things that way. And then there's kind of the more nefarious methods that I've kind of been suggesting where it's like, hey, there are a lot of places on the web you can publish content, right. You can use those as an avenues to influence these LLMs on a different answer because it's a, it's more of a consensus machine. Or if you're able to feed it the same answer in multiple places, it's more likely to suggest that as a next token predictor that as the answer than if you were like, oh, I only have this most up to date information on our website, which by the way is outside of your knowledge cutoff date. So I really hope you use the web search tool so that people get the right answer. Are you going to leave that to chance if you're an SEO? No. You're going to try to fix that, right. You're going to realize that that is a problem and limitation and you're going to look at the technical foundation of things and go like, what are some solutions we can implement today?

Excellent. Those are really good points. Yeah. Because that's, yeah, I could see people taking advantage of that very, very quickly. Now with respect to, for me, with a lot of this, especially when we're talking about earlier with the, the reduction in clicks, right. Or the reduction in visits and the reduction in what you could like kind of summarize as metrics. If I'm one of these people that has to create like, like I remember back in the day, right, like you know, some of the very more basic, you know, reports, especially if you were at a company that, you know, was just investing in search optimization or. Oh, and just to give a shout out, I wanted to make sure the thing Dharmesh was talking about, he referred to it as search agent optimization, so SAO instead of SEO. So I thought that was pretty interesting. But in the scenario I'm bringing up, like, you know, you work for a company that's trying to invest in SEO and a lot of the reports that you would run at the, I'm talking like years ago because now it almost seems like there's a lot of arguments can be made that that's not really a good indicator of quality or success. But you know, there's, there, there's the traffic reports, there's the this and that, right? And I'm not talking about like what, you know, how, what the backup is on the Dan Ryan, you know, in the city. I'm talking about like actual like, you know, things that were, if these numbers are going down, people that don't understand the reasoning behind it and the shift start to like sweat. Do you know what I mean? So like we're, I guess like in an AI world like this or in an AI dominated search landscape, like how do we, how are we going to measure SEO success? Or how do we shift the way we're measuring SEO success?

That's a booming industry right now, right, where people are offering AI measurement tools. And currently the approach is to track various prompts that you would be able to put into these solutions and then measure either through visibility or citations of your website. And then you could also re tag certain sites that then show up that you, if you're in a larger company, might consider either owned or earned media, which is a very agency way to say, like, can you influence, you know, those other sites? And then you're like, you're actually part of what we kind of control on the narrative on the web. So what has changed? Well, currently there is no volume metric to any of these tools. And so there's a lot of estimates being thrown everywhere. And because the underlying technology between comparison kind of a user's query and the content that comes out is the same, which is embeddings, a search engine not only matches the words that you type in, it also matches to the rough meaning of a web page. And that question you throw in, same thing with LLMs. Those are similar in the way kind of we talk about topic clusters in SEO, where a topic cluster is, hey, let's go on a very broad topic that people that are interested in what I do may search about. Let's look at kind of that journey while they investigate this topic. May I, as a business or a brand or whatever, may Offer things that are tangential or related, or help solve some sort of problem they have in that topic. And then what are the related searches they do and where do I fit in that picture? What are the terms I should go after? What are the content I could go after that would fill that gap? And then where are the points where it makes sense for me to capture that traffic to some sort of mechanism? As a business, I can capture whether it's leads, whether it's a phone call, a form filled out, an ebook they capture and leave an email. And then I nurture with emails and all that.

Right.

All that stuff you're used to on the web and all that, now you're condensing that, then you're going like, oh. And then we have an equivalent for these LLMs and what we're tracking. We don't have the volume metric anymore, but the behavior is the same and they're staying on the GPT or the LLM or the chat experience. We have no analytics on that part as well. We're relying on again that visibility and that citation. We're relying on the answer being relatively positive because we can track some of the inputs that go into these answers. Then we're hoping that the end result is they go to our homepage, they call us or some way. And right now the best method to do that attribution is like, how'd you hear about us? It's like, oh, did you use AN LLM or ChatGPT to find us throughout the way? Like that's our best hack right now as we are lacking those volume or analytics in those two places. And that's kind of how you're drawing that correlation to that lost traffic that you just had all in search. It's not that the traffic is gone and people don't need to buy anything anymore. It's just that you're not seeing it because your analytics doesn't cover it and the intent is still there. The behavior has changed, but the tracking is not there yet.

Gotcha.

Okay.

Yeah, because that's, that's kind of, that's gonna like play havoc on those that whose like main responsibilities are to measure these things and are to bring those reports and stuff. Because I know like depending on the how not in depth, that's probably not the right word but like depending on the place you work for, how invested they are in what's going on with all of this, with results, with search and like how, you know, AI is playing a role in this, it can be probably a big headache trying to have to explain some of this stuff when it's like, you know, we just want to sell XYZ widgets and we, you know, 90,000 people come to the site a month now you're telling me, you know, only 60,000 come, you know, fix it. And it's like. But you're not, you know, so it's. Yeah, I could see where this becomes. And I mean, again, like, with everything, time will heal all wounds. But, like, right now I. I do empathize with, like, people that are kind of put in that position right now. Speaking of with time, like, where do. And I love. And especially with AI with this question because, like, it changes daily. So, like, depending on the time frame I give, it could be like a thousand different answers all at once. But, like, in the next year or two, let's say that. Because then that gives you, what, 365 answers times two, almost. Where do you. Where do you see this go? Like, where you see it going? Like, where do you see AI's impact on SEO going from this point on in the next year or so?

And we will call you on this later on.

Yeah, exactly. I mean, like, we're gonna. We're gonna take this clip and then we're gonna say, look, everyone, Victor was wrong, you know, and. But we're gonna hold it. We're gonna hold it, right? We're gonna hold it and they're just gonna wait for the right moment, set.

A calendar, invite for a year from.

It's just gonna be random messages from us. Hey, remember. Remember the thing you said? Just like video clips all day long. But I mean, like, as a best estimate, because like I said, I mean, next week we could be talking about a whole different thing that's happened or a whole different way of doing something. You know, like, look at how fast MCP servers just, you know, hit the ground and completely change the way people were talking about things. And that was in a matter of like a week or so, right? So the best you can. And we won't hold you to it, I promise.

Like, next two years, it's kind of like already happening. And there's just so much more interest in AI generated content and workflows, right? How to do it, right? You're going to see a lot of job descriptions kind of change and titles and names change a lot in the next two years. It's going to be assumed that you need some sort of AI knowledge for any kind of search job going the next two years. And that's why there's a lot of worry and concern because some folks don't really update their knowledge on what's changing. So you're just not going to be able to pass off and say, I'm an SEO. It's like, well, do you know any of this AI stuff? It's like, nope. It's like, oh, good luck. Definitely don't ask an LLM going like, how do I pass this interview on this? Because it's not going to have up to date information on that. So yeah, you can. So again, you're going to see a lot more collaboration between SEOs and like content generation and how to find that balance. You're going to see job descriptions change, you're going to, you're going to see renewed interest on kind of the more technical side of SEOs, which is log file analysis understanding. You know, we like to say what you eat is what you are.

Right?

That's a really common idiom for bots. It's like what they're gonna ingest is what they are gonna believe your site is about, right? And so looking at those crawl logs, seeing if you're, you know, technically sound or if there are issues and you definitely wanna fix those so that the bot has a good representation of what your business entity is and is actually accurate, right? There's going to be renewed interest there. And yeah, I think you're going to expect all these traditional third party tools, be it Ahrefs, Semrush and all that, they're all just going to throw a bunch of AI features out there to solve that booming industry of like, how do we measure the impact now that traffic is down and there's so much interest in this growth in AI, they're going to fill that out with a bunch of features.

How does one. Oh, go ahead.

No, I was gonna say I'm gonna call because you mentioned a good point about the technical SEO, especially when it comes to implementation of the technical SEO as well. That's where I can see that most people are probably gonna be like, oh, I can just do this right and just make some changes and you could really cripple a site if you do some wrong stuff. So it's one of those things where that's where I can, in my head, that's where I see the intersection of before, like people would be like, I.

Don'T want to go talk to the.

Developers, they're just like sitting in the dark basement, they're not going to listen to me. And it's like one of these things where like if you're coming to them with technical things. Like I'm wondering what the working relationship, if it's going to cause more stress or if it's going to mend that working relationship that happens. Like you know we always have that developers meet marketers fights always happen. Like do you foresee like development teams coming closer together and being more cross organizational working knowledge wise or do you still see this separate silos of work where the SEO people just stick to SEO don't really do like web based knowledge and the web based people know that. So like you get, you give them your plans then they figure out how they're going to implement it. Or do you see more like triads kind of like working together to fix these issues?

Yeah, I think SEOs become the technical people if they're in a marketing org and then they become like a creative person if they're in a product org.

Right.

And so let's talk like crawlers visiting, right? Like if you're doing a CDN and you have like you have bot detection and you want to prevent denial of service attacks, right? And your CDNN does that for you and somehow it accidentally blocks these LLM bots, what's going to happen to your visibility, right? And you're going to have to have that discussion with your developers or you're going to need to have that relationship with your deliverers in the first place to even know that is happening.

Right.

And so I see that getting closer in that regards because now it's not just about marketing those marketing things and then ask for dev to make it look some way. Now it's like no, you have to be very particular. Like hey, did you know that these are the listed IP ranges from these LLMs? Can we put a allow list or wait list on these IPs so that we always show up? Can we not serve JavaScript bot challenges because we know they're bots anyways. It's stuff like that. And then they also understand why that's important and that's if we don't even show up for these bots, we don't show up for these LLM generated answers. And that's where the hallucination kicks back in. If these web search tools from these LLMs can't access your site, it's not going to say it can't reach the site. Half the times they'll actually just hallucinate and go like oh yeah, I visited a site and this is what it says and it's actually an excerpt from all these other sites. And then if you really Dig into that, you realize like, wow, sure, it'll try to defer to your site, but when it can't, it'll. That's when a lot of that funny information misinformation happens. And I highly recommend for any developer just to go on to their LLMs, go look at the network requests of what pops in, and you'll see all sorts of funny things. They'll search for queries, they'll tell you the titles and descriptions and snippets that they're pulling for, for that rag. And then to summarize and generate things, it's all there. And for a marketer that's like, oh, that's like developer stuff. Or an SEO's like, oh, this is our stuff. And then you know, like developer is like, oh, that's like kind of marketing but also kind of technical. Like there's like. So SEOs are in that funny middle ground right now and hopefully we'll be building a lot more bridges for both teams.

Yeah, no, no, yeah, that's cool.

Now you talked about, I want to ask you, what are some of the like staying like, because you said like not having that knowledge then put you, you know, at a certain point there's not going to be able to be an SEO that says that they don't know AI tooling. So is there basically any kind of resources that you recommend for people to, to start to try to jump into that if they haven't already?

That is a great question. I'm lazy, so I would say you should.

I think you mentioned there was one. Isn't there like a. There was a newsletter, I think you mentioned to me once there was a. What is it? SEO fomo.

Right.

SEO firmos from Aleta. Yeah, but you know, if you're starting out from like scratch, scratch, maybe also from alada Solis Awesome SEO, you would probably go with LearningSEO IO. I honestly think you should start with actual problems first instead of just focusing on education. Right now, you are just one or two experiments away from being an expert in this stuff. Actually get your hands dirty. Actually go type in some prompts, look at what the answers are, see if you can change it, see if you can publish pages and have funny things come out. If you are actively doing these things and seeing how these things change, you're already ahead of most folks that aren't trying these things. You can read up all you want, but that's all going to be old stuff and there's nothing better like an hour. Right? So. Yeah, yeah. And that's why there's no, like, I would not recommend signing up for any courses right? On like this is how you do this stuff. I would say like if I were to really recommend folks on like what should you do? You should focus on the fundamental documents on like crawling, indexing and ranking. Like that stuff is still relevant for AI answers. And I would say like any human behavior related things in marketing, you can chase the algorithm, but that will just help you beat your competitors. But if you chase after how human behaviors will evolve, that is what the algorithms are trying to address, right? So if you want to be ahead of the algorithm, you have to really understand human behavior. Now the complexity here really is how is this new technology changing human behavior? And if you're able to answer that better and create a good experience there, that I believe is kind of the ultimate question we all need to answer to really win and be ahead of the algorithms and also be a good business.

Right?

Like how do you actually show out in those instances? So that's the most wide answer I can give you as to like how to stay ahead is, you know, study your customers and anticipate again going back to the dumb way right now is I ask them, how did you find us about us, did you have any difficulties? And then just start by being less wrong.

Right.

So instead of focusing on this is the way to do it, patch out all the things, all the points of friction that they're experiencing in that journey and then figuring out the root cause behind them inside those LLMs or outside in Google search with AI overviews wherever it may be, and you'll just be in a better position and you'll have much more relevant experience as well.

Excellent, thank you. We are running up on time so I wanted, is there anything you wanted to give a shout out to Victor or anything like that?

No, I'm good. I wanted to stay, you know, stay happy, healthy, be kind to the folks around you. You know, there's a lot of change in the world right now. And yeah, I think as long as you're, you know, grounded in your core beliefs and the people care about and you're able to take care of them, I think we're all very fortunate to be able to do so and just spread that energy around and I think that that's ultimately what I look forward to. Even with all this AI change happening. I am a techno optimist, if you will.

Love it.

No, thank you. Yeah, we appreciate you coming on and talking because I mean, like I said, this is one of my favorite topics and I think it's like, obviously it's very timely, of course, and probably will be timely for the next, who knows, months, if not years coming up. So, no, we really do appreciate you coming on. I wanted to thank you for taking the time out and for all your rock stars out there that were watching and listening again, don't forget, please hit, like, tell everybody. Share us with all of your friends and family and strangers. Just walk up to strangers in the street and just start telling them about us, please. Never hurts. And, yeah. So, you know, thank you from. On behalf of all of us here. Thank you very much for watching and listening. And I'll leave you with this. I mean, this is why it's very, very important to start tagging your data and to start making sure that the data that you're creating is relevant and good and pure. Because it only took Ultron five minutes to get put on the Internet to find. Find out that humanity was the problem and then tried to eliminate it. So really get out there and start tagging that data.

Dang.

It's true.

Dang. Look at you.

Look at you with the Marvel references.

Wow.

It always works. You know what I mean? There's certain things that you can make references with that just always work. This is one of them.

Love it. All right, y'.

All, see everybody later.