AI crawlers are consuming vastly more data than they send traffic back. ChatGPT crawls 1,500 pages per visitor, Anthropic crawls 60,000. This signals a fundamental shift where data extraction, not referrals, is the new economy.
Chapters
I don't know if you saw the Cloudflare CEO interview where he explained the data that he sees in terms of crawls to referral rates. So, you know, websites crawl your site and they give you a referral in return. That's kind of the business model of the web, right? So Google crawls your site and because they do so, they give you a hyperlink as a result and forward traffic to you. That's the deal. And it used to be 1 to 2. So 1 crawl, 2 referrals. That used to be the early days of the web. I crawl you once and I— sorry, I crawl you twice and I send you one traffic in return. That changed for Google. That changed to 1 to 18. So they crawl you 18 times, they send you one visitor. That's already something people would say, ah, it's not a great deal, is it? Well, on ChatGPT, that's 1,500 to 1. So they crawl you 1,500 times, they send you one visit. And guess what? For Anthropic, it's 60,000 to 1. So they crawl 60,000 pages of yours and they send you one visit. So there is something coming towards you. And people say, I don't see traffic from AI, so it can't be big. Well, yeah, it can, because they crawled you 60,000 times and they only sent you one. So it's already there. You just don't see it that clearly because they're not forwarding traffic. It's a different model. Data becomes the currency.