Back to Index

Yann LeCun on Autonomous Driving: Deep Learning is Obviously Part of the Solution | AI Podcast Clips


Transcript

(gentle music) - Elon Musk is confident that large scale data and deep learning can solve the autonomous driving problem. What are your thoughts on the limits, possibilities of deep learning in this space? - It's obviously part of the solution. I mean, I don't think we'll ever have a self-driving system or at least not in the foreseeable future that does not use deep learning, let me put it this way.

So in the history of sort of engineering, particularly sort of AI-like systems, there's generally a first phase where everything is built by hand. Then there is a second phase, and that was the case for autonomous driving, you know, 20, 30 years ago. There's a phase where there's a little bit of learning is used, but there's a lot of engineering that's involved in kind of, you know, taking care of corner cases and putting limits, et cetera, because the learning system is not perfect.

And then as technology progresses, we end up relying more and more on learning. That's the history of character recognition, the history of speech recognition, now computer vision, natural language processing. And I think the same is going to happen with autonomous driving, that currently the methods that are closest to providing some level of autonomy, some, you know, decent level of autonomy, where you don't expect a driver to kind of do anything, is where you constrain the world.

So you only run within, you know, a hundred square kilometers or square miles in Phoenix, but the weather is nice and the roads are wide, which is what Waymo is doing. You completely over-engineer the car with tons of lidars and sophisticated sensors that are too expensive for consumer cars, but they're fine if you just run a fleet.

And you engineer the thing, the hell out of the everything else. You map the entire world, so you have complete 3D model of everything. So the only thing that the perception system has to take care of is moving objects and construction and sort of, you know, things that weren't in your map.

And you can engineer a good, you know, SLAM system and all that stuff, right? So that's kind of the current approach that's closest to some level of autonomy. But I think eventually the long-term solution is going to rely more and more on learning and possibly using a combination of self-supervised learning and model-based reinforcement or something like that.

(upbeat music) (upbeat music) (upbeat music) (upbeat music) (upbeat music) (upbeat music)