Judea Pearl says human-level AI needs to answer questions about counterfactuals, regret, and free will. A key sign: robots that criticize each other's mistakes, like a coach correcting players, which lets them assign responsibility and improve together. Pearl argues machines need empathy-modeling, mapping how others think, to become ethical.
I know you're not a futurist, but are you excited? Have you when you look back at your life long for the idea of creating a human level intelligence system?
Yeah, I'm driven by that all my life I'm driven just by one thing. But I go slowly. I go from what I know to the next step incrementally.
So without imagining what the end goal looks like, do you imagine what the.
End goal is going to be? A machine that can answer sophisticated questions, counterfactuals, regret, compassion, responsibility and free will.
So what is a good test? Is a Turing Test a reasonable test?
Free will doesn't exist yet.
How would you test free will?
And that's so far we know only one thing. I mean, if robots can communicate with reward and punishment among themselves and hitting each other on the wrist and say, you shouldn't have done that. Okay, playing better soccer. Because they can do that.
What do you mean because they can do that?
Because they can communicate among themselves.
Because of the communication they can do.
Because they communicate like us. Reward and punishment. Yes. You didn't pass the ball the right, the right time and so forth. Therefore you're going to sit on the bench for the next two. If they start communicating like that, the question is, will they play better soccer as opposed to what is it part what they do now? Without this ability to reason about reward and punishment, responsibility. And so far I can only think about communication.
Communication is not necessarily natural language, but just communication.
Just communication. And that's important to have a quick and effective means of communicating knowledge. If the coach tells you he should have passed the ball, Ping. He conveys so much knowledge to you as opposed to what? Go down and change your software? Right. That's the alternative. But the coach doesn't know your software. Right. So how can a coach tell you you should have passed the ball, but that our language is very effective. You should have passed the ball. You know your software, you tweak the right module. Okay. And next time you don't do it.
Now that's for playing soccer. Or the rules are well defined.
When you should pass the ball is not well defined. No. It's very soft, very noisy. Yes, you have to do it under pressure.
It's art. But in terms of aligning values between computers and humans, do you think this cause and effect type of thinking is important to align the values, values, morals, ethics under which the machines make decisions is the cause effect. Where the two can come together is.
Necessary component to build a ethical machine. Because the machine has to empathize to understand what's good for you, to build a model of yours, of you as a recipient, which should be very much. What. What is compassion? They imagine that you suffer pain as much as me.
As much as me.
I do have already a model of myself, right? So it's very easy for me to map you to mine. I don't have to rebuild the model. It's much easier to say, oh, you're like me, okay? Therefore, I would not hate you.
And the machine has to imagine, has to try to fake to be human, essentially. So you can imagine that you're. That you're like me, right?
And moreover, who is me? That's the first. That's consciousness. They have a model of yourself. Where do you get this model? You look at yourself as if you are a part of the environment. If you build a model of yourself versus the environment, then you can say, I need to have a model of myself. I have abilities, I have desires, and so forth. Okay? I have a blueprint of my software. Not a full detail because I cannot get the halting problem, right? But I have a blueprint. So on that level of a blueprint, I can modify things. I can look at myself in the mirror and say, if I change this, tweak this model, I'm going to perform differently. That is what we mean by free will and consciousness.
