This is a review of programming memes with George Hotz. Quick mention of two sponsors, Four Sigmatic, the maker of delicious mushroom coffee and Public Goods, my go-to online store for minimalist household products and basic healthy food. Please check out these sponsors in the description to get a discount and to support this channel.

And now, on to the memes. Let me ask you to do a meme review or inspect some printed black and white memes and maybe give a rating of pass or fail, like binary, if this is a win or a lose. These are mostly from the programming subreddit. - Man.

- You don't like this one. This doesn't pass. - I mean, you were like, I could do it straight up like PewDiePie meme review. This meme gets a one out of 10. (laughing) - Wow, this is too much text. I half-assed looked at this. - Already too much text.

(laughing) - Are you gonna skip on the text? - Well, what am I doing? Yeah, I don't know about this. I think this plays on bad stereotypes. (laughing) - Isn't that all of memes? I don't know. - No, I think, like, now this one, this meme's much better. - Okay.

- You can spend six minutes doing something by hand when you can spend six hours failing to automate it. Now this one I like. - Crys in PowerShell. (laughing) What are you doing in PowerShell? Do you do that yourself? Like, do you find yourself over-automating? - Of course. I mean, but you learn so much trying to automate.

You know, you could spend six minutes just driving there instead of spending, you know, 10 years of your life trying to solve self-driving cars. - That's true. That's the programming spirit. - Of course. - I don't know what that is. - Of course, you know, it's like you're trying to overcome laziness.

- Kind of true. - You end up putting in way more effort to overcoming laziness than just overcoming it. - 78,000 upvotes on that one? Jesus, okay. - Mine doesn't have the, oh wow. Oh, that's up there, I see. This just, yeah, this is why I trust programmers a lot more than I trust doctors.

- You like Googling. You like-- - Doctors think they have some, like, divine wisdom because they went to med school for a few years. I'm like, yeah, dude, I understand. I didn't Google this on WebMD. Actually, like, I read these three papers. Like, you know? - Yeah. - I think I know.

I remember once when I was, let's say, drug shopping and one of the doctors referred to Adderall as a Schedule B drug. And I can't correct this guy. That's drug-seeking behavior to an extreme. Schedule II, it's not Schedule B. But, you know, like, doctor, you don't know that? The DEA gave you a pad to prescribe and you don't know about the drug scheduling system?

Like, like-- - Yeah. Yeah, programmers don't have that. They just outsource. Do you think that becomes a problem? If you outsource the entirety of your knowledge to Stack Overflow? You write stuff from scratch pretty well. - Yeah, yeah, yeah. They asked me on Instagram, they were like, what's the integral of two to the X?

And I'm like-- - They'll look it up. - Well, the integral of E to the X is E to the X. So it's like something like that. - Yeah. Yeah, the same with Wolfram Alpha. You just start looking it up. - Uh. (both laughing) - Yeah. - That's pretty good.

That's funny. That's the first-- - That's the first funny one? - Yeah. - You do testing? You do like user, not user, unit testing? - Oh, we do unit testing, yeah. We have, our regression testing's gotten a ton better in the last year. Now we're pretty confident, if the tests pass, that at least it's gonna go into someone's car and do something, right?

Versus in the past, like sometimes we'd merge stuff in and then one of the processes wouldn't start. - Right, so you think that kind of testing is still really useful for Autonomous Vehicles? - Not as much unit, but like some kind of, God, bad with words today, holistic, like integration testing.

- Sure. The thing runs. - Yeah, that it runs, and that it runs in CI, and that it doesn't output crazy values. And then, actually, we wrote this thing called Process Replay, which just runs the processes and checks that they give the exact same outputs. And you're like, this is a useless test, because what if something changes?

Well, yeah, then we update the process replay hash. This prevents you from, if you're doing something that you claim is a refactor, this will pretty much, it will check that it gives the exact same output every single time, which is good. And we run that over like 60 minutes of driving.

- But that one's a win for you, you get past the 10, the scale of 10. - Yep, yep, yep, yep, yep. That's an eight out of 10. - Eight out of 10. - Can't give anything at 10 out of 10, that's a good meme. - Breaks the rule.

- Yeah, yeah, I mean, you know, this is why I don't use IDEs, that's just true. - It's just true, it's not even funny. - That's just true, it's not even funny. - But I gotta say, I mean, to me, it's kind of funny, 'cause it's so annoying, it is so annoying with IDEs.

That's why I'm still using it, EMAX, is 'cause IDE, it's like clippy on steroids. - It is, it is, of course. They're gonna make good ones, though. I always still wanna, this is a company idea I wanna do, and I've trained language models on Python. You can train these big language models on Python, and they'll do a pretty good job reading and checking for bugs and stuff.

- So you hope for that, like machine learning approaches for improved IDEs? - Yeah. - That's very interesting, yeah. - Yeah, I think machine learning approaches for improved, look at Google's auto-suggest in Gmail. - Yeah. Oh yeah, even the dumb thing that it does is already awesome. So there's a lot of basic applications of GPT-3 language model that might be kind of cool.

Yeah. - I think that the idea that you're gonna somehow get GPT-3s to replace customer service agents, I mean, really, this reflects so badly on customer service agents, and why don't you just give me access to whatever API you have? - I don't know, this one is... - Yeah.

- I just saw a picture. I actually wondered if it works at all. (both laughing) - That's good. That's good. The last line is good. - Okay, thanks, bye. - No, I'd rather you mine cryptocurrency in my browser than use my speakers. - Yeah. I feel that way about pop-ups too.

Just anything. - I mean, those you can at least block. It's like, you know what? The only thing I do want to autoplay is like YouTube. - Why do news sites start autoplaying their news? I don't get... I haven't been to a news site in years. I do not read the news.

I still hear about the news 'cause people talk about it. I've never been to a news site. - Yeah, who goes there? Who goes there? - Who goes to these sites? And in fact, even on Hacker News, I'll always avoid it if the link is like a New York Times or CNN.

I've read a few things, but yeah, those like the pop-uppy news sites. - Yeah, those websites are broken. Somebody needs to fix it. That's at the core why journalism is broken, actually, just 'cause like the revenue model is broken, but actually the interface. Like I have to, like I literally, I want to pay the New York Times and the Wall Street Journal.

I want to pay them money, but like they make it like to where I have to click like so many times and they want to do-- - And they have to have a login and have a New York Times password? - Yes, and also they're doing the gym membership thing where they try to make you forget that you signed up for them.

So that they charge you indefinitely. Like just be up front and let it be five bucks. And then everybody would, it's your idea, which is like just make it cheap, accessible to everyone. Don't try to do any tricks. Just make it a great product. - Yeah, people like that.

- And everybody will love it, yeah. - Actually, what I want to see also, I've seen them start to exist, is ad block that also blocks all the recommendeds. I don't want trending topics on Twitter. Please get rid of it. These trending topics have zero relevance in my life.

They're designed to outrage me and bait me. Nope, don't want it. - You know, one interesting thing I've used on Twitter, I had to turn it back on 'cause it was tough, is there's Chrome extensions people could try, is it turns off the display of all the likes and retweets and all that.

So all numbers are gone. It's such a different, people should definitely try this. It's such a different experience. 'Cause I've realized that I judge the quality of other people's tweets. - By, of course. - By the number of likes. Like it's not, you know, basically if it has no likes, then I'll judge it versus one that has like several thousand likes.

I'll just see it differently. And when you turn those numbers off, I'm lost. At first I'm like, what am I supposed to think? It's a beautiful thing. - That's right, but then how much is it manipulated? - Yeah, it totally is. But it's an interesting experience, worth thinking about.

- I found that, so actually I do, I block, you can, I do it with ad block. I have like, like trending topics. Anything that's global and applicable to everybody, I definitely do not want. I do not want to know what's trending in the United States right now. It's always some like political agitprop or like some, it's agitprop a lot of the times.

- But at the same time, like to push back slightly, for me, trending, like if there's a nuclear war that breaks out. - That's how they get you, that's how they get you. And I just trust that if nuclear war breaks out, someone's gonna come tell me. - A friend will text you?

- A friend will text me, like, you know, yo. - Hey, are you in a shelter or what? - Right? - Yeah, okay. So if it's bad enough, you'll know. - Yeah, I did also try turning off YouTube's recommendations, but I realized that they do provide value to me.

Like the tailor-- - Customized to you. - Yeah, yeah. - As opposed to a general one, like a trending one, yeah. Now YouTube does a pretty good job. So this one is about how Stack Overflow can be really rough. Asking a question on Stack Overflow, be like. - No.

(laughing) No, I've never asked a question on Stack Overflow. - You've never, yeah, it's rough. - I don't comment, okay? I've never, if someone, if there's a comment on the internet, I just want you to know that they probably do not reflect my values. - Well, I mean, there is some truth to that too.

One of the documents that I make everyone, everyone at Comma has to read it, it's linked from the thing, is it's Eric Raymond and it's how to ask smart questions. - Yeah. - And it's just like, well, you know, the quality of the answer you get depends a lot on how you will phrase the question.

To be fair, I think, yeah, the auto keyword is not, is a, I think Stack Overflow likes it where it's like, there is an answer. There's not really an answer to that. - Right. - That's a great Reddit thread. - But some of the most interesting questions are a little bit-- - Ambiguous, yeah.

- Ambiguous, yeah. - I do this in interviews, I ask ambiguous questions. And I just see how, I found that that's so much more useful for gauging candidates than like-- - To see how they reason through things? - To see just like what they think of and like what language they use and whether they show familiarity or not.

- What do you, by the way, just as a quick aside, is there any magic formula to a good candidate? - Intelligence and motivation. - Intelligence and motivation, yeah. Motivation, passion, yeah. And you can see it through just conversation? I always wish there was a test that you could just online, like a form that you can fill out.

- Well, okay, so there's the old problem of, testing for intelligence is easy because, okay, smart people can lie and say they're dumb, but dumb people can't really lie and say they're smart. But testing for motivation is much harder. So we do this, we have a micro-internship. We bring people in for two days paid to come work on something real in our code base.

And we see like, you know, are you just doing this as like a job interview? If you're doing this as like, okay, I gotta like check this box, then yeah, you're not a good fit. - That's awesome, that's a good idea. And then you see, and then you can be picky and see like if there's a, is there a fire there like that?

And we see, and like now we hire a lot of people, you know, who at least, like, if you're coming to work at Kama, you're kind of expected to have read the open pilot code. All right, like the best candidates are the ones who like read the code and ask questions about it.

Like it's open source, right? The beauty of Kama is you don't need to be hired by us to start contributing. True. - Yeah, are you obsessed about resource constraints? - Some, not size, I don't care about bytes, but CPU. - CPU. - Well, CPU is watts, and watts is bad.

- Watts is bad. - Watts is, we gotta pump them somewhere where we're lowering the CPU temp. People complain about the Kama 2's overheating. We have a solution. We're lowering the CPU frequencies. We're gonna ship that in the next one. But don't worry, we've made the code more than efficient enough to cover for it.

- Awesome, that's, yeah, that's one way to go. - Beautiful. - This is good. I mean, okay, five out of 10. - Which one? - My code doesn't work, let's change nothing. I do that all the time. - That's the weird thing, and it often works. It's running stuff again.

I don't get it. I don't get how this world, this universe is programmed, but it seems to work. Just like restarting a computer, restarting the system. Like this audio setup, sometimes it's just like not working, and then I'll just shut it off and turn it back on, and it just works.

I interpreted this beam totally differently. You interpreted it as in like, this is a good idea. I interpreted it as in, I find myself doing this all the time. - And this is dumb, yeah. - I just run it again. I know it's gonna give me the same answer, and I'm not gonna be happy with it, but like, you know.

I found this, I did Advent of Code last December. It's, Advent of Code's great. It's a programming challenge every night at midnight for December. Yeah, I'm proud of myself, proud of how I did on leaderboard. Yeah, I found myself doing that all the time. I'm like, this has to be right.

I don't understand. Yup. - This is like, this is kind of, you embody this in some sense. You're able to, I mean, at least I've seen you able to accomplish quite a lot in a very short amount of time. It's interesting. - Yeah, sometimes. I don't know, some of them, like people don't realize how much like I cheated at Twitch Slam.

You know, like, okay. To be fair, I did write that slam from scratch on there. I did not have like a copy of it written, but I also spent like the previous six months studying Slam. So like, you know, I had so much-- - There's a base there, sure.

- Going into it, whereas like with these other things, like I don't have anything going into it. And people are like, why isn't it like Twitch Slam? Well, you know. - So this one is just, you find this to be true? Is this funny at all? - I find it to be-- - Is this a three out of 10?

- Yeah, three out of 10. There's a lot of threes in there. - This is a machine learning question. - Yeah, true. - Yeah. I mean, this is the tension. I get this, I mean, sometimes this meme pisses me off a little bit, because people that like learn machine learning for the first time, and they're struggling with like object detection, and they think how is this supposed to achieve general intelligence.

- That's 'cause you're just doing a first intro to what software 2.0, as opposed to like, when you scale things, I mean, you can achieve incredible things that would be very surprising. - I mean, it's the same thing with software 1.0. You know, they sit there and they write "Hello World," and they're like, how is this thing supposed to fly rockets?

- Right, and it does. The thing is, it does. - Just takes a whole lot more effort than you think. I don't know, but I'm very-- - You're bullish on neural networks. - I'm bullish on neural networks. I think neural networks are definitely going to play a component. I'm bullish on what neural networks are, which is a beautiful, generic way.

I was, one of our screening questions is, what's the complexity of matrix multiplication? And I was explaining this, like why fundamentally this is true, and then I went a little further with it. I'm like, you know, neural networks is just like matrix multiplications, interspersed with nonlinearities. And there is something, so, the fact that that's such an expressive thing, and it's also differentiable, it's also quasi-convex, like it's convex-y, which means convex optimizers work on it, like, yeah, well this isn't going anywhere.

Of course not. - Yeah, the question is, what are the limits of its surprising power? - I think that we haven't seen the loss function yet. We haven't seen the right loss function. You know, it's gonna be something fancy that looks, I think, like compression. And I haven't seen these things really applied.

Maybe there was that one paper where they tried, like, surprise to solve Montezuma's Revenge. - Yeah, there's a lot of fun stuff in RL that reveals the power of these things that's yet to really be understood, I think. So, that's kind of an exciting one. Thank you for putting up with this nonsense of a paper-based meme review, George.

(upbeat music) (upbeat music) (upbeat music) (upbeat music) (upbeat music) (upbeat music)