- Let's jump back to it, artificial intelligence. What's your thought of the state of where we are at currently with artificial intelligence? And what do you think it takes to build human level or superhuman level intelligence? - I don't know what intelligence means. That's my biggest question at the moment.

And I think it's 'cause my instinct is always to go, well, what are the foundations here of our discussion? What does it mean to be intelligent? How do we measure the intelligence of an artificial machine or a program or something? - Can we say that humans are intelligent? Because there's also a fascinating field of how do you measure human intelligence?

- Of course. - But if we just take that for granted, saying that whatever this fuzzy intelligence thing we're talking about, humans kind of have it. What would be a good test for you? So Turing developed a test that's natural language conversation. Would that impress you? A chat bot that you'd want to hang out and have a beer with for a bunch of hours or have dinner plans with.

Is that a good test, natural language conversation? Is there something else that would impress you? Or is that also too difficult to think about? - Oh yeah, I'm pretty much impressed by everything. I think that if- - Roomba? - If there was a chat bot that was like incredibly, I don't know, really had a personality.

And if I didn't, the Turing test, right? Like if I'm unable to tell that it's not another person, but then I was shown a bunch of wires and mechanical components, and it was like, that's actually what you're talking to. I don't know if I would feel that guilty destroying it.

I would feel guilty because clearly it's well-made and it's a really cool thing. It's like destroying a really cool car or something. But I would not feel like I was a murderer. So yeah, at what point would I start to feel that way? And this is such a subjective psychological question.

If you give it movement, or if you have it act as though, or perhaps really feel pain as I destroy it and scream and resist, then I'd feel bad. - Yeah, it's beautifully put. And let's just say act like it's a pain. So if you just have a robot that not screams, just like moans in pain, if you kick it, that immediately just puts it in a class that we humans, it becomes, it anthropomorphizes it.

It almost immediately becomes human. So that's a psychology question as opposed to sort of a physics question. - Right, I think that's a really good instinct to have. If the robot- - Screams? - Screams and moans, even if you don't believe that it has the mental experience, the qualia of pain and suffering, I think it's still a good instinct to say, you know what, I'd rather not hurt it.

- The problem is that instinct can get us in trouble because then robots can manipulate that. And there's different kinds of robots. There's robots like the Facebook and the YouTube algorithm that recommends the video, and they can manipulate it in the same kind of way. (upbeat music) (upbeat music) (upbeat music) (upbeat music) (upbeat music) (upbeat music)