How to improve your agent's personalization: Application Evals and Epistemic Evals #aievals #foryour

You know, application evals are making sure that the LLM in your system is responding in an acceptable or unacceptable way. And that could mean a lot of things. But when we want to be specific about how the application is responding to create a user centric experience using the AI, that's where epistemic evals can help you to understand the user, understand what is a good experience for them, understand what their values, what their beliefs are, and how to interact with them in a way that optimizes the experience that they're having with the appatia.