A short Spanish-language YouTube explanation (by Jeremy Black) of what web spiders (Google robots) are and how they crawl websites. The speaker explains that crawlers enter sites via the homepage, scan all text and links, and therefore webmasters should prioritise important links on the homepage so Google assigns higher importance to desired pages (example cited: Excursiones Catalunya).
What is a web spider or a Google robot? In the end they are the same thing. Look, when Google enters a page like mine from Excursiones Catalunya, the first thing it does is crawl all the content, both text and links of the website. The first one always enters from the homepage and what it does is crawl everything it finds. That is why we have to prioritize in spiders to help web spiders by always having the most important links from the home page to where we want Google to give the most importance to our pages.
