Large language models use specialized retrieval bots to crawl websites and pull current information when answering questions. Website owners should optimize their sites to be easily crawled and indexed so AI assistants can find and cite their content.
those are, those are the, the types of bots that, you know, are going and, and you're seeing like citations from and the LLMs, they're like finding information and returning it back to the user. They do combine, the answer is combined with that and the training data, but the, the retrieval bots are the bots where you want to optimize your site for. And also are, are the bots where you're going to see, um, crawling different pages on your site and like, and understand like what they're trying, what information they're trying to gather and retrieve and turn, return back to these. So they're really important to pay attention to, right? Right now in this new world of like showing up in LLM models.
Roll Claude out from one laptop to the whole GTM org | Sam Gong & Zach Vidibor
