Adam Sand explains why AI gives shorter answers as it approaches its context limit. The model isn't broken, just overwhelmed, and rushes toward an endpoint to manage its remaining capacity before running out of space.
AI generates something, a behavior that we started to call context anxiety. It's not broken, it's overwhelmed. And you might notice that when you're talking to AI, it starts to respond a little shorter. It starts trying to like get you to get to the point. You might be trying to get me to get to the point. Well, that's what that context anxiety is. It's like saying, hey, I've been listening to you yabber on for a while and I've been giving you responses. Do you have a destination for us? Because you are reaching, you're reaching towards that context limit. And that's when that the model has what we call context anxiety.