back to indexAll-In Summit: In conversation with Vinod Khosla
Chapters
0:0 Besties welcome Vinod Khosla to All-In Summit ‘23!
2:28 “Most VCs add negative value”
5:22 AI & OpenAI
10:37 “The need to work will disappear”
14:3 “Capitalism is by permission of democracy”
15:26 Universal basic income
17:4 AI value creation beyond LLMs
21:9 Incumbents don’t innovate
23:52 Fusion
27:7 Autonomous public transit
30:10 Asset bubbles and the state of venture
33:13 Timing the market
00:00:00.000 |
Please join me welcoming Vinod Khosla to stage. 00:00:35.640 |
Just by way of background, I think we all know Vinod. 00:00:43.240 |
His Indian Army officer dad wanted his kid to join the army 00:00:46.760 |
and Vinod decided instead to go into business 00:00:49.760 |
after reading about Intel and getting inspired 00:00:52.120 |
by co-founder Andy Grove, an immigrant who got funding 00:00:57.380 |
Vinod later got a master's in biomedical engineering 00:01:05.600 |
He finally got accepted and received his MBA in 1980 00:01:08.920 |
and he worked at several startups, some of which failed 00:01:15.840 |
Started in 1982 with his Stanford classmates, 00:01:19.160 |
Scott McNeely, Andy Bechtolstein and Bill Joy. 00:01:22.560 |
Vinod raised $300,000 in seed capital from venture firm 00:01:29.920 |
and within five years, Sun made a billion dollars 00:01:33.960 |
He became a GP at Kleiner where he helped create NextGen 00:01:37.160 |
which he sold to AMD for 28% of its market cap, 00:01:39.760 |
the first successful Intel microprocessor clone company 00:01:45.640 |
maybe we'll talk about this today, was Juniper Networks 00:01:48.020 |
where the firm's $3 million investment in the 90s 00:02:06.060 |
and I had three competing offers and I picked Vinod. 00:02:16.360 |
Founders Fund and Andreessen Horowitz for my Series B. 00:02:25.400 |
- Vinod's whole point was VCs typically add negative value. 00:02:29.760 |
We're gonna put a senator on your board that we know 00:02:36.180 |
and the partners they brought to the table for me 00:02:42.600 |
I'll also say I always gave people advice on Vinod 00:02:48.920 |
And I'm like, let me tell you something about Vinod. 00:02:51.360 |
I've never told you this in public, but I said, 00:02:53.520 |
the thing about Vinod is you go into a meeting with Vinod 00:03:09.920 |
He has to ultimately decide what the right decision is. 00:03:12.840 |
And Vinod will cast for you a vision of all the things 00:03:18.800 |
and try and make you extend your vision for your business 00:03:22.900 |
And through that thought, through that conversation, 00:03:25.160 |
through the visioneering that he can help you do 00:03:26.960 |
as an entrepreneur, sometimes you need to listen 00:03:32.240 |
But I will say that the role he plays is really important 00:03:36.360 |
and I've seen it work across some of the most 00:03:38.440 |
important companies in Silicon Valley and the world today. 00:03:56.040 |
that can actually help you make a better decision. 00:04:01.520 |
I prefer brutal honesty to hypocritical politeness. 00:04:16.740 |
- Well, they take a very short-term approach. 00:04:24.800 |
Companies being recapped, they asked us to participate. 00:04:33.160 |
"If you get rid of it and restart the company 00:04:37.220 |
"with positive revenue in the right technology approach, 00:04:45.320 |
But they hung on to revenue since the beginning of this year. 00:04:51.900 |
as opposed to a people approach to the business. 00:05:08.680 |
of really investing in the technology, lower burn rate, 00:05:12.160 |
not try and show higher revenue so they can be acquired, 00:05:31.080 |
as people are framing it today for some time. 00:05:44.120 |
'cause we haven't had this question answered on our show 00:05:46.280 |
about how open AI went from non-profit to for-profit 00:05:50.800 |
- Well, let me tell you a more general story first, 00:06:17.480 |
they would never adapt TCP/IP for the internet. 00:06:21.240 |
And I said, "Fine, we'll build Juniper to build TCP/IP." 00:06:29.720 |
above what is probably your home service today, OC12. 00:06:39.680 |
Because we've seen the internet on an exponential 00:06:45.120 |
looked very uninteresting and nobody believed in it. 00:06:50.000 |
We invested in Juniper for the 2,500x return for us 00:06:54.200 |
at Kleiner, one of the largest returns in venture, 00:06:57.680 |
at least when Wall Street Journal did a piece 00:07:00.480 |
on the Snap IPO of largest venture returns ever. 00:07:24.120 |
"we don't know when, but we'll have to redefine 00:07:54.520 |
So 20% doctor, 80% AI is the thing I defined. 00:07:59.040 |
And I wrote another blog called Do We Need Teachers? 00:08:09.560 |
That was January of 2012, so about 12 years ago. 00:08:14.560 |
So five years ago, late 2018 is when I started 00:08:35.360 |
Whether it was in three years, five years, or 10 years, 00:08:39.360 |
I was pretty convinced it would be pretty phenomenal 00:08:43.320 |
and there'd be practical applications along the way 00:08:50.840 |
So we placed a bet, we placed a long-term bet. 00:08:53.840 |
You know, this audience is gonna hear from Bob Mumgard. 00:08:57.840 |
You know, five years ago I placed a bet on fusion 00:09:03.120 |
If we get it to work, these are humongous returns, 00:09:20.280 |
was twice the largest previous investment I'd made 00:09:31.040 |
- How did that go from non-profit to for-profit 00:09:52.920 |
It's a very good model to sustain and generate profit 00:10:01.200 |
some of these examples are really, really great. 00:10:04.400 |
IKEA, Bosch, they have very large non-profit ownership. 00:10:08.640 |
And I think that's a very good model to scale. 00:10:12.120 |
I mean, I just mentioned, do we need doctors? 00:10:18.240 |
My wife's doing a primary care or tutor AI as a non-profit. 00:10:26.520 |
The question is, how can you gather the resources 00:10:29.680 |
to scale the social good you're trying to do, 00:10:51.520 |
Because this one does feel qualitatively different, 00:10:55.360 |
and it does seem to be moving at a faster pace. 00:11:09.080 |
and do you have those concerns of displacement 00:11:11.200 |
that a lot of people seem to be concerned about? 00:11:20.520 |
So let me start with that 20, 25 years from now. 00:11:53.160 |
I love my job, so 25 years from now, health permitting, 00:12:02.520 |
and Warren Buffett's gone a lot longer than I have. 00:12:10.440 |
and I'll keep doing it, and other people will. 00:12:15.800 |
What you call jobs are what people get paid for. 00:12:27.440 |
So I do think the nature of jobs will disappear. 00:12:33.440 |
Now societies will have the transition from today 00:12:38.440 |
to that vision of not needing to work if you don't want to 00:12:58.760 |
I suspect, let's take something I'm very hawkish on, China. 00:13:06.880 |
to enforcing what they think is right for their society 00:13:24.000 |
And certain societies may choose not to adapt these. 00:13:29.000 |
And I think the societies that do that will fall behind. 00:13:43.820 |
But we've also seen massive transitions before. 00:13:46.700 |
Agriculture was 50% of US employment in 1900. 00:13:55.900 |
the biggest area of employment, got displaced. 00:14:01.020 |
- Well, cost went down and productivity went up. 00:14:22.660 |
this messy transition to the vision I'm very excited about 00:14:30.300 |
I do think the nature of capitalism will have to change. 00:14:37.560 |
But I do think the set of things you optimize for, 00:14:41.740 |
when economic efficiency isn't the only criteria, 00:14:56.220 |
It was a long piece that said AI will cause great abundance, 00:15:10.740 |
And I think I ended that to close this answer off 00:15:14.560 |
with we will have to consider UBI in some form. 00:15:26.100 |
- Which was my follow-up, which is if you give people UBI, 00:15:28.980 |
do you have concerns of the idle mind and what happens? 00:15:33.980 |
We've seen in other states when 25% of young men 00:15:42.380 |
And so what do you think the societal issues will be 00:15:58.080 |
It's very hard to predict how complex systems behave. 00:16:01.860 |
And it's very hard for me to sit here and say, 00:16:12.080 |
I know other people addicted to producing music. 00:16:18.640 |
for people to find meaning in, or personal meaning. 00:16:25.200 |
just wanna perfect their participation in a certain sport. 00:16:30.200 |
I love X Games because it wasn't even remotely 00:16:39.560 |
And I think if people have very early in their life 00:16:44.900 |
I hope that adds the meaning human beings will need. 00:16:48.920 |
And in some sense, that's what I was talking about in 2000 00:16:57.280 |
Your assembly line job won't define you for your whole life. 00:17:15.380 |
I think even yesterday there was a leak of something 00:17:18.340 |
where Meta's trying to really superpower Llama 2 00:17:25.740 |
We talked about this a little bit on the pod, 00:17:29.560 |
wanna scorch the earth on the foundational model side. 00:17:38.180 |
how you've organized, where the value's getting created, 00:17:51.400 |
was when we looked at it, when I looked at it, 00:17:54.780 |
there was two major centers of excellence in AI. 00:17:59.740 |
- They had DeepMind and Google Brain, but Google. 00:18:05.380 |
And I was very worried the Chinese might win that. 00:18:14.660 |
And I love Graham Allison's book, "Destined for War." 00:18:20.900 |
But I thought it'd be valuable to create a third center, 00:18:27.700 |
and that was part of the motivation in funding open AI. 00:18:36.820 |
And you know, there's efforts in every country, 00:18:55.220 |
Almost all the efforts I have seen are very limited. 00:19:06.780 |
what besides LLM will play an important role. 00:19:17.980 |
More NVIDIA GPUs, scale the parameters, more data, 00:19:29.660 |
we made an investment in a symbolic logic idea. 00:19:37.980 |
didn't look that interesting for five years ago, 00:19:40.580 |
2018, late '18 is when we really made our decision to invest. 00:19:48.940 |
But I'm saying, what else would look like that in 2028? 00:20:00.140 |
- Are you worried about-- - Is it probabilistic 00:20:14.540 |
there are other axes so that we're not looking back 00:20:16.820 |
a few years from now and there's just massive CUDA lock-in 00:20:19.900 |
and nothing can happen without one gatekeeper? 00:20:28.260 |
So I'll place all those long bets on alternative ways 00:20:36.100 |
I think is the more likely scenario, though, who knows? 00:20:39.980 |
- But even among just, imagine LLMs do it all. 00:20:53.020 |
I also do think governments will have their own efforts. 00:20:57.900 |
China, of course, has one, but plenty of other rumblings 00:21:11.260 |
but broadly speaking venture, give us the state of the union 00:21:34.580 |
that came from a large company or institution. 00:21:44.580 |
The only two examples I could find was in the early '70s, 00:21:51.300 |
when I was, Bank of America put debit and credit 00:22:16.300 |
- You know, did General Motors do driverless cars, 00:22:35.940 |
but somebody at Lockheed Martin do SpaceX or Rocket Lab? 00:22:40.900 |
We're investors in Rocket Lab, so I like it a little more. 00:22:51.020 |
But think, think of every large social change. 00:23:02.540 |
You know, the only thing somebody came up with 00:23:09.420 |
And I said, they didn't take any risk, right? 00:23:14.940 |
- They took a risk with somebody else's money. 00:23:24.380 |
But my idea is innovation comes from groups like this. 00:23:29.500 |
And I'm completely convinced, I lost the original question, 00:23:41.420 |
you know, four or five years ago invested in Fusion. 00:23:44.700 |
Now we may fail, I think we are much more likely 00:23:47.940 |
to succeed sitting here today than fail, but it's possible. 00:23:52.660 |
- Can you talk about that just while you're on Fusion? 00:23:56.020 |
We've got both Bob and David from Helion tomorrow morning. 00:23:59.340 |
And there's broadly, call it six or some number 00:24:02.900 |
of general architectural approaches to solving the-- 00:24:06.180 |
- Yeah, there's six approaches, a dozen companies. 00:24:12.820 |
But how do you think about the role that a Commonwealth 00:24:17.740 |
how big of a role does capital play in getting there? 00:24:26.180 |
billion dollar plus at this point, open AI similar. 00:25:00.460 |
the single biggest risk in building the architecture, right? 00:25:17.140 |
we got lots of interesting applications in nuclear medicine. 00:25:21.740 |
- You know, a fusion reactor is a particle accelerator. 00:25:24.940 |
- That technical breakthrough, we can pivot somewhere else. 00:25:26.940 |
- Yeah, nuclear medicine, MRI machines, lots of areas. 00:25:30.900 |
So let's go build with double digit millions, 00:25:33.740 |
which is not a huge amount in the context of the upside 00:25:37.780 |
of maybe a bigger upside than the 2,500 X Juniper had. 00:25:50.460 |
- Well, today we are not, but when we started, 00:25:54.780 |
that was clearly to look at off ramps, right? 00:26:07.320 |
- So how do you know that that bet, that investment, 00:26:15.720 |
any one of which could have their own breakthrough, 00:26:22.300 |
mostly because I think Bob's just a phenomenal CEO. 00:26:48.600 |
- Sax, you had a question I wanted to make sure 00:27:12.860 |
One of my biggest beefs is the traffic in cities. 00:27:19.420 |
to replace most cars in most cities in 25 years. 00:27:24.380 |
By building a different kind of public transit system. 00:27:32.620 |
You know, Waymo went the way of autonomous cars. 00:27:55.040 |
So if you can increase passengers per hour through it, 00:28:05.060 |
Public transit autonomously driven in small parts 00:28:13.420 |
so unscheduled, on demand, any time of the day or night, 00:28:28.580 |
- So like Uber Pool, but with a larger mini bus type format. 00:28:50.420 |
I don't wanna spend too much time on one particular idea, 00:29:08.740 |
that is not trained on any YouTube or public music. 00:29:59.380 |
I said, "I love a challenge like that, let's go." 00:30:04.380 |
"I'm in, no diligence, didn't need all that." 00:30:10.300 |
- Yeah, I think where Tamath was gonna go a minute ago 00:30:14.740 |
is that we talk a lot on the pod about the fact 00:30:27.060 |
with these ZURP policies going back, I don't know, 15 years. 00:30:41.420 |
I mean, I think we see now that the size of venture funds 00:30:44.500 |
is contracting, that new funds are gonna be smaller. 00:30:56.620 |
We've tried to sort of get, well, are half of them fake? 00:31:02.420 |
how much did this asset bubble sort of inflate 00:31:09.220 |
- You know, it inflated things a lot in certain areas, 00:31:12.980 |
and it deflated things a lot in certain areas. 00:31:16.620 |
But let me give you two analogies to understand this. 00:31:21.380 |
and there's a fair number of investors I hear here, 00:31:23.980 |
only care about two emotions, fear and greed. 00:31:33.500 |
is staying focused on the long-term in the middle. 00:31:40.940 |
you'll get inflation, and then you will get deflation. 00:31:55.340 |
in Wall Street prices and valuations and all that. 00:32:06.820 |
you can't tell when the dot-com bust happened. 00:32:10.180 |
So I'm saying the reality of using the internet 00:32:13.260 |
didn't change just because people had inflated values 00:32:17.980 |
That's just a fear reaction and a greed reaction. 00:32:25.740 |
If you got the right to build a railroad between two cities, 00:32:29.260 |
you could offer strips on the market, big bubble. 00:32:38.060 |
after the bubble collapsed in England in the 1830s 00:32:43.580 |
My point is the reality of the underlying business, 00:32:46.260 |
if you're adding value, does not change that much. 00:33:00.620 |
not the short-term, hey, he's valuing it twice, 00:33:04.300 |
so let me pay up, and then you'll pay twice as much as that 00:33:14.860 |
- So I think it's a question of you can't time the market. 00:33:18.780 |
- As long as you know that this is an investable technology, 00:33:22.060 |
an investable trend, timing what price you're coming in at, 00:33:31.500 |
You know, in inflationary times, you pay a little bit more, 00:33:40.220 |
and then when it goes into a deflationary cycle, 00:33:47.300 |
And good investors will help guide entrepreneurs correctly 00:33:52.020 |
We've seen a lot of that in climate investing. 00:34:13.580 |
is replace soy as a protein source on this planet, 00:34:16.460 |
and I think we are well on our way to do that. 00:34:23.980 |
whether a valuation in the end goes up or down 00:34:28.500 |
It doesn't really matter if you're adding fundamental value 00:34:38.660 |
I think that we all kind of appreciate your leadership, 00:34:45.300 |
to make those big bets in very low probability outcomes, 00:34:52.740 |
than that multiple, that ratio that you're getting. 00:35:00.540 |
how much you share with all of us who are behind you 00:35:05.220 |
I didn't mention it, but you've taken a lot of time 00:35:07.220 |
for Trimoth, you've taken time for me and my career, 00:35:09.620 |
and I just think it's like a great gift to us. 00:35:19.820 |
40 or 50 people to try to get a job in VC in 2000. 00:36:13.780 |
- I'm gonna have my dog take an admission in your driveway.