LARRUZ tests whether Claude 3 can identify locations from satellite images. Claude 3 mistakes an Australian coastline for Cyprus, correctly spots Pilbara in Western Australia, and vaguely identifies southwestern Egypt. It can recognize broad regions but struggles with precision and consistency.
Did you know that Claude 3 can analyze any satellite image and tell you where it is on Earth. But how accurate is it? Apparently, it can take any screenshot from Google Maps and track it down and tell you where this is. All right, so let's give this a shot. Let's go ahead and take a random image of Australia here. Let's say. I mean, let's start with something that it should be able to get, like a more distinct coastline, like so. Okay, it thinks it's Cyprus. That is not correct. Let's give it one more try. What about this part over here? Okay, it says Pilbara in Western Australia. Is that right? Yeah, that's the correct region. Not bad. Okay, let's. One more. Okay, so how about this random spot in Egypt? I mean, surely it won't be able to distinguish this southwestern Egypt. That's not entirely correct, but it did get Egypt correctly. So I can tell you from my testing here, it doesn't always work this well, especially if you pick something super indistinguishable, like maybe this square. She's not going to be able to do it. I mean, it's not that precise, but it's not bad.
