Back to Index

Garry Kasparov: IBM Deep Blue, AlphaZero, and the Limits of AI in Open Systems | AI Podcast Clips


Chapters

0:0 Intro
1:0 Losing was painful
2:0 Analyzing the match
3:0 Closed systems
4:0 Chess standards
5:0 Deep Blue
6:0 Humans vs Machines
7:0 Chess vs AlphaZero

Transcript

You're lost to IBM Deep Blue in 1997. In my eyes, that is one of the most seminal moments in the history. Again, I apologize for being romanticizing the notion, but in the history of our civilization, because humans as a civilization for centuries saw chess as the peak of what man can accomplish, of intellectual mastery.

And that moment when a machine could beat a human being was inspiring to just an entire anyone who cares about science, innovation, an entire generation of AI researchers. And yet, to you that loss, at least if reading your face, seemed like a tragedy, extremely painful, like you said, physically painful.

Why? When you look back at your psychology of that loss, why was it so painful? Were you not able to see the seminal nature of that moment? Or was that exactly why it was that painful? As I already said, losing was painful, physically painful. And the match I lost in 1997 was not the first match I lost to a machine.

It was the first match I lost, period. That's... Oh, wow. Oh, wow. Yeah, it's... Right. That makes all the difference to me. First time I lost, it's just... Now I lost, and the reason I was so angry that I just, I had suspicions that my loss was not just the result of my bad play.

So though I played quite poorly, just when you started looking at the games today, I made tons of mistakes. But I had all reasons to believe that there were other factors that had nothing to do with the game of chess. And that's why I was angry. But look, it was 22 years ago.

It's more than the bridge. We can analyze this match and this is with everything you said. I agree with probably one exception, is that considering chess as the sort of, as a pinnacle of intellectual activities was our mistake. Because we just thought, "Oh, it's a game of the highest intellect and it's just you have to be so intelligent and you could see things that the ordinary mortals could not see." It's a game.

And all machines had to do in this game is just to make fewer mistakes, not to solve the game. Because the game cannot be solved. I mean, according to Koval Shanin, the number of legal moves is 10 to the 46th power. Too many zeros, just for any computer to finish the job in next few billion years.

But it doesn't have to. It's all about making fewer mistakes. And I think that's this match actually. And what's happened afterwards with other games, with Go, with Shogi, with video games, it's a demonstration that the machines will always beat humans in what I call closed systems. The moment you build a closed system, no matter how the system is called, chess, Go, Shogi, Dota, machines will prevail simply because they will bring down number of mistakes.

Machines don't have to solve it. They just have to... The way they outplay us, it's not by just being more intelligent. It's just by doing something else, but eventually it's capitalizing on our mistakes. When you look at the chess machines ratings today, and compare this to Magnus Carlsen, is the same as comparing Ferrari to Usain Bolt.

The gap is, I mean, by chess standards is insane. 34, 3,500 to 2,800, 2,850 on Magnus. It's like difference between Magnus and an ordinary player from an open international tournament. It's not because machine understanding is better than Magnus Carlsen, but simply because it's steady. Machine has steady hand. And I think that is what we have to learn from 1997 experience and from further encounters with computers and sort of the current state of affairs was AlphaZero, you were beating other machines.

The idea that we can compete with computers in so-called intellectual fields, it was wrong from the very beginning. By the way, the 1997 match was not the first victory of machines over... Over grandmasters. Over grandmasters. Yeah. And I played against first decent chess computers from late '80s. So I played with the prototype of Deep Blue called Deep Thought in 1989, two rapid chess games in New York.

I won handily to both games. We played against new chess engines like Fritz and other programs. And then it was Israeli program Junior that appeared in 1995. Right, right, I remember. So there were several programs. I lost few games in Blitz. I lost one match against the computer chess engine in 1994, rapid chess.

So I lost one game to Deep Blue in 1996 match, the match I won. Some people tend to forget about it that I won the first match. But we made a very important psychological mistake thinking that the reason we lost Blitz matches, five minutes games, the reason we lost some of the rapid chess matches, 25 minutes games, because we didn't have enough time.

If you play a longer match, we will not make the same mistakes. Nonsense. So yeah, we had more time, but we still make mistakes. And machine also has more time. And machine will always be steady and consistent compared to humans' instabilities and inconsistencies. And today we are at the point where nobody talks about humans playing against machines.

Humans can offer handicap to top players, still will be favored. I think we're just learning that it's no longer human versus machines. It's about human working with machines. That's what I recognized in 1998, just after leaking my wounds and spending one year and just ruminating so what's happened in this match.

And I knew that we still could play against the machines. I had two more matches in 2003 playing both deep free and deep junior. Both matches ended as a tie. Though these machines were not weaker, at least probably stronger than deep blue. And by the way, today, chess app on your mobile phone is probably stronger than deep blue.

I'm not speaking about chess engines that are so much superior. And by the way, when you analyze games we played against deep blue in 1997 on your chess engine, they'll be laughing. And it also shows us how chess changed because chess commentators, they'll look at some of our games like game four, game five, brilliant idea.

Now you ask Stockfish, you ask Houdini, you ask Commodore, all the leading chess engines. Within 30 seconds, they will show you how many mistakes both Gary and deep blue made in the game that was trumpeted as a great chess match in 1997. - Well, okay, so you've made an interesting, if you can untangle that comment.

So now in retrospect, it was a mistake to see chess as the peak of human intellect. Nevertheless, that was done for centuries. So in Europe, because you move to the Far East, they will go, they're showing you- - Games, games. - Again, some of the games like board games.

Yeah, I agree. - So if I push back a little bit, so now you say that, okay, but it was a mistake to see chess as the epitome. And then now there's other things maybe like language, like conversation, like some of the things that in your view is still way out of reach of computers, but inside humans.

Do you think, can you talk about what those things might be? And do you think just like chess that might fall soon with the same set of approaches, if you look at alpha zero, the same kind of learning approaches as the machines grow in size? - No, it's not about growing in size.

It's about, again, it's about understanding the difference between closed system and open ended system. - So you think that key difference, so the board games are closed in terms of the rules that they actions, the state space, everything is just constrained. You think once you open it, the machines are lost?

- Not lost, but again, the effectiveness is very different because machine does not understand the moment it's reaching territory of diminishing returns. It's the, to put it in a different way, machine doesn't know how to ask right questions. It can ask questions, but it will never tell you which questions are relevant.

So it's like about the, it's a direction. So I think it's in human machine relations, we have to consider so our role and many people feel uncomfortable that the territory that belongs to us is shrinking. I'm saying so what, this is eventually will belong to the last few decimal points, but it's like having so very powerful gun and all you can do there is slightly alter direction of the bullet, maybe 0.1 degree of this angle, but that means a mile away, 10 meters of target.

So that's, we have to recognize that is a certain unique human qualities that machines in a foreseeable future will not be able to reproduce. And the effectiveness of this cooperation, collaboration depends on our understanding what exactly we can bring into the game. So the greatest danger is when we try to interfere with machine superior knowledge.

So that's why I always say that sometimes you'd rather have, by reading this picture is in radiology, you may probably prefer an experienced nurse than rather than having top professor, because she will not try to interfere with machines understanding. So it's very important to know that if machines knows how to do better things in 95%, 96% of territory, we should not touch it because it's happened.

It's like in chess, recognize, they do it better. See where we can make the difference. You mentioned AlphaZero, I mean, AlphaZero, it's actually a first step into what you may call AI, because everything that's being called AI today, it's one or another variation of what Claude Shannon characterized as a brute force, is a type A machine.

Whether it's Deep Blue, whether it's Watson, and all these things, the modern technologies that are being trumpeted as AI, it's still brute force. It's the, all they do, it's they do optimization. It's this, they are, they keep improving the way to process human generated data. Now AlphaZero is the first step towards machine produced knowledge, which is by the way, it's quite ironic that the first company that championed that was IBM.

Oh, it's in backgammon. Yes, you should look at IBM, it's a new gammon, it's the scientist, he's still working at IBM. They had in the early 90s. It's the program that played in all the AlphaZero types, so just trying to come up with own strategies. But because of success of Deep Blue, this project had been not abandoned, but just it was put on cold.

And now it's, everybody talks about the machines generated knowledge, so as revolutionary, and it is, but there's still many open-ended questions. Yes, AlphaZero generates its own data. Many ideas that AlphaZero generated in chess were quite intriguing. So I looked at these games with, not just with interest, but it was quite exciting to learn how machine could actually juggle all the pieces and just play positions with a broken material balance, sacrificing material, always being ahead of other programs, one or two moves ahead by foreseeing the consequences, not over calculating, because other machines were at least as powerful in calculating, but it's having this unique knowledge based on discovered patterns.

After playing 60 million games- Almost something that feels like intuition. Exactly. But there's one problem. Yeah. Now, the simple question, if AlphaZero faces superior point, let's say another powerful computer accompanied by a human who could help just to discover certain problems, because I already, I looked at many AlphaZero games, I visited their lab, spoke to Demis Kasabis and his team, and I know there's certain weaknesses there.

Now if these weaknesses are exposed, then the question is, how many games will it take for AlphaZero to correct it? The answer is hundreds of thousands. Even if it keeps losing, it's just because the whole system is based. So it's now, imagine, so you can have a human by just making a few tweaks.

So humans are still more flexible, and as long as we recognize what is our role, where we can play sort of the most valuable part in this collaboration, so it will help us to understand what are the next steps in human-machine collaboration. Thank you. Thank you. Thank you. Thank you.

Thank you. Thank you. Thank you. Thank you. Thank you. you