back to indexMarket Predictions, Rates & Inflation, DOGE, CES, AI Compute | BG2 w/ Bill Gurley & Brad Gerstner
Chapters
0:0 Intro
2:58 Frontline Ideas for 2025
7:2 The Bogeyman (Interest Rates and Inflation)
9:21 Mega Cap Valuations & Expectations
14:2 Big Tech CapEx
16:51 Scaling Inference
20:11 Future of AI
39:50 Role of Power in AI Development
42:58 Interest Rates & Economic Growth
45:11 Federal Spending & DOGE
54:15 Regulatory Landscape for AI
61:27 Co-opetition in AI
77:6 Reasoning Models & Chain of Thought
00:00:00.000 |
Elon said he thinks that every cognitive task 00:00:03.240 |
that can be done by a human will be able to be done 00:00:11.060 |
the value of all that human labor that you're replacing 00:00:30.840 |
Happy new year, I have on a, you probably can't tell, Bill, 00:00:33.820 |
I have on a blue shirt today, not a black shirt. 00:00:36.900 |
I have on my green pants, a little Notre Dame spirit 00:00:48.480 |
could win in advance, that'd be pretty spectacular. 00:00:51.040 |
You and I were talking about some of this insanity 00:00:53.720 |
going on in LA, and I know we both have a friend 00:00:57.220 |
who's lost a house and there's a lot of this debate 00:01:01.620 |
going on online, whether or not any of the policies 00:01:07.260 |
at least to the severity of the thing that's going on. 00:01:12.940 |
both really appreciate is as we're entering 2025, 00:01:16.940 |
just the opportunity, I feel like the conversation 00:01:26.660 |
And I think it rubs a lot of people the wrong way, 00:01:28.740 |
but I tend to be in the camp that the more open debate 00:01:31.220 |
and accountability, it's just the better, right? 00:01:34.140 |
And no matter what side of the political aisle 00:01:37.140 |
you end up being on, we should all be in favor 00:01:41.900 |
And when you look at how horrific these scenes are in LA, 00:01:46.780 |
you have to ask the question, what could we have done better? 00:01:52.980 |
I have this framework in my head that I think about 00:01:58.900 |
which is a lot of people, I think, evaluate politicians 00:02:03.900 |
and policies based on what they think the intent 00:02:08.460 |
of the decision was, and they fail to follow up 00:02:12.740 |
and then see if the output or the outcome is identical 00:02:17.740 |
to what they thought the original intent was. 00:02:20.020 |
And I think all too often the original intent of something 00:02:24.100 |
may have sounded good, or you might be voting for someone 00:02:33.220 |
or in many, many cases, achieves the exact opposite of that, 00:02:38.220 |
then you really have to ask yourself, what's the point? 00:02:42.100 |
And so, yeah, I hope that this type of accountability 00:02:58.820 |
Well, I thought we could do something unique and different, 00:03:02.940 |
if you're up for it, related to this time of year. 00:03:06.860 |
So, obviously, large investment funds like yourself 00:03:16.140 |
Sometimes the reporting is certainly looked at annually, 00:03:20.140 |
and sometimes even some of the fees and whatnot 00:03:25.340 |
And so I'm sure that creates a annual cycle for you. 00:03:29.020 |
And as you've been going through that process, 00:03:32.640 |
I thought it'd be really cool to expose the listeners 00:03:36.420 |
to both the analysis that you're going on now, 00:03:42.300 |
And so, how does someone, a large professional investor 00:03:46.540 |
like yourself, think about this time of year, 00:03:49.320 |
and specifically, what are you looking at now, 00:04:08.180 |
What informs how we think about the annual cadence 00:04:18.860 |
We ended last year in this great conversation with Dylan 00:04:38.500 |
that all impact how we think about this year. 00:04:44.180 |
I not only look at kind of errors and omissions, 00:04:46.420 |
like what could we have done better in our public trading 00:04:52.420 |
and we had a great year and I'm proud of the team, 00:04:54.260 |
or whatever, but there's a lot we always can do better. 00:04:58.540 |
And then I try to look ahead, not at January, 00:05:03.780 |
of where I think the world will be in December 00:05:08.100 |
So you really have to get in the habit of being an analyst, 00:05:16.540 |
but also thinking about all of the competing things 00:05:18.820 |
going on, interest rates, inflation, et cetera, the backdrop. 00:05:25.020 |
I journal to myself and I make everybody on the team 00:05:30.460 |
and this started at the beginning of December, 00:05:38.740 |
What are the big things you're thinking about, 00:05:47.540 |
That 2025 could just be a really phenomenal year. 00:05:58.340 |
And at the same time, we have these mega trends 00:06:08.660 |
but ancillary things like robotics and self-driving cars 00:06:23.580 |
On the other side, you gotta look around the world 00:06:26.640 |
and you say, well, we got a situation in the Middle East, 00:06:37.940 |
but I could make an argument how all those things get better. 00:06:46.720 |
At the same time, valuations bill are quite high 00:06:54.940 |
So the world assumes that things are going to be better. 00:06:59.140 |
And as we look at it, I kept asking the team, 00:07:03.900 |
Like, what's the thing that we're not thinking about 00:07:09.420 |
I would say that the boogeyman that's out there, 00:07:14.780 |
and some of them have been shorting the U.S. tenure, 00:07:24.480 |
and higher rates combined with higher valuations 00:07:29.480 |
that could put a damper on at least the market 00:07:35.340 |
And again, this is just like one of the potential outcomes, 00:07:38.020 |
but we've seen the tenure go up almost 100 basis points 00:07:44.420 |
They thought the Fed was gonna be cutting rates 00:07:54.020 |
And so I think we have to explore why is that happening? 00:07:58.800 |
So that would, I guess, be the overall framework. 00:08:08.340 |
I would share with you, like just as an observant 00:08:31.980 |
in terms of just how much excitement there is 00:08:50.540 |
but I would say there's plenty, a wall of worry as well. 00:08:53.300 |
For every conversation I have with people in Silicon Valley 00:08:56.480 |
who say they're gonna invest more in compute, 00:09:02.820 |
I have another call maybe with a big fund in New York 00:09:13.700 |
And so there are the words that everybody says, Bill, 00:09:23.100 |
is just like looking at where the valuations are 00:09:31.820 |
the S&P 500 recently peaked at about 22 times. 00:09:36.820 |
So in Q4 '21, it was about 22 times earnings. 00:09:42.260 |
It troughed in '22 at 16 times, and now we're at 23 times. 00:09:52.040 |
like it's near its kind of recent peak valuation. 00:10:01.160 |
If you look at Google, trading about 21 times. 00:10:04.180 |
If you look at NVIDIA, it peaked at 66 times. 00:10:11.140 |
And I would tell you closer to 28 or 30 times our estimates. 00:10:15.580 |
And so I look at the valuations for these businesses, Bill. 00:10:24.540 |
Correct. And so like, and we'll put all these charts in, 00:10:28.560 |
but at the highest level, I look at that and I say, 00:10:39.280 |
And it's not as good a deal as you got at the start of '24. 00:10:49.560 |
But the question really is, and you brought up, 00:10:54.980 |
Like first, what was earnings growth last year? 00:11:01.580 |
So here's a chart that shows the mega cap earnings growth 00:11:22.620 |
but Bill, earnings were up tremendously, 44% is extraordinary. 00:11:36.400 |
If you look at the other 495 companies in the S&P, 00:11:46.020 |
in the S&P 500 in 2024 relative to the mag five. 00:12:09.580 |
There's certainly a deceleration in these businesses. 00:12:13.700 |
and by the time you get to 2025, it's very hard comps, 00:12:17.060 |
and still growing 20% on the massive, massive 00:12:21.080 |
earnings and revenue bases of these companies. 00:12:27.940 |
But the interesting thing here that kind of worries me 00:12:42.260 |
And so I asked myself, well, where does everybody think 00:12:58.300 |
They expect industrials to go from negative 4% 00:13:13.500 |
with the tax cuts, but I think that only speaks 00:13:15.700 |
for about 30% of that bump in earnings growth. 00:13:26.740 |
if you don't see this acceleration in non-tech earnings 00:13:35.940 |
that looks anything like 2023 or 2024 anyway. 00:13:39.620 |
But if you just said, can we get to 10 or 15% on the market, 00:13:46.140 |
You have to see this acceleration in earnings, number one. 00:13:49.660 |
And number two, you really have to see interest rates 00:13:56.420 |
that becomes a big albatross on market performance in 2025. 00:14:04.660 |
I wanna stick with the large cap companies for a second. 00:14:08.300 |
You and I were having a discussion about their CapEx trends. 00:14:12.220 |
And this is something that's remarkably different 00:14:16.060 |
than any window of past tech investing, right? 00:14:19.540 |
This level of CapEx wasn't a part of the equation 00:14:29.220 |
like what's happening with CapEx in these large companies? 00:14:34.220 |
CapEx was growing before the chat GPT moment, 00:14:39.420 |
but nothing like we've seen it grow over the last two years 00:14:42.660 |
and we're forecasting it to grow for the next couple years. 00:14:45.980 |
So this first slide just shows the combined CapEx 00:14:50.020 |
of Google, Meta, Amazon, Microsoft, Apple, and Oracle, 00:15:10.020 |
of the incremental free cashflow of those businesses, right? 00:15:17.900 |
that those are really NPV positive investments 00:15:24.220 |
So you heard Satya say, I think they are expected, 00:15:32.820 |
And you just, you know, he said earlier in the year, 00:15:37.980 |
that they expected to spend 80 billion in CapEx this year. 00:15:51.780 |
he said, yeah, that's a big number in anyone's universe. 00:15:56.780 |
Coming from his point of view, he's like, yeah, that's big. 00:16:10.000 |
will people actually spend this money, right? 00:16:12.680 |
Like, will they actually buy more compute in 2025? 00:16:22.400 |
the conversations at CES, there are going to, 00:16:25.680 |
these investments are gonna show up in 2025, right? 00:16:29.980 |
And the reason they're showing up, I believe, 00:16:32.880 |
is that people are still seeing a lot of returns on training. 00:16:38.780 |
these different scaling laws that they're building for. 00:16:42.180 |
So whether that's pre-training, whether that's post-training, 00:16:47.100 |
they're investing in making the models better. 00:16:48.920 |
But the other one, which is coming on really strong, 00:17:24.460 |
He expected inference to go up by 100,000 times, 00:17:33.820 |
and that's all new compute that's gotta get built out 00:17:49.100 |
You've got Apple and Amazon kind of in the middle 00:17:55.460 |
And then Apple, ironically, is falling below 5%. 00:18:05.660 |
And then the other thing is those same top two 00:18:09.620 |
are bouncing up against 100% of free cash flow, right? 00:18:20.340 |
How do you think about whether percent of revenue 00:18:28.460 |
I will tell you, this is a very, very robust debate. 00:18:41.780 |
Yeah, you know, they being the biggest investor in Omaha. 00:18:50.860 |
that this is like the telecom buildup, right? 00:18:56.620 |
I have a lot of respect for Elon, for Satya, for Sundar, 00:19:00.620 |
for the people who are making these investment decisions. 00:19:10.380 |
and I think he expects that to grow significantly. 00:19:16.740 |
on the dollars that he's putting into the ground. 00:19:22.020 |
And you can make a bet for one of two reasons. 00:19:35.500 |
And I think that's where some of these concerns emanate from. 00:19:41.380 |
that part of the reason the multiples on these businesses 00:19:45.780 |
have not, you know, kind of gotten even higher 00:20:13.860 |
people celebrated raising these bigger and bigger 00:20:16.940 |
And you and I would look at each other quizzically 00:20:18.820 |
and we'd say, you know, people lost the script. 00:20:27.940 |
And I would say today, the thing that's very clear to me 00:20:37.260 |
super high returns on the incremental capital 00:20:48.780 |
you have to have an imagination to believe, right? 00:20:51.460 |
Just like when Google was investing gobs in early 2000s 00:20:55.340 |
or when Amazon was investing gobs in '08, '09, 2010 in AWS, 00:21:00.340 |
you have to believe that there is a pot of gold 00:21:06.940 |
I see the revenue growth inside some of these businesses, 00:21:10.460 |
the inference revenue growth inside these businesses. 00:21:29.660 |
You know, I'd say max three or four years, maximum. 00:21:34.660 |
And Elon said he thinks that every cognitive task 00:21:40.020 |
will be able to be done by an AI within three to four years. 00:21:46.180 |
the value of all that human labor that you're replacing 00:21:57.300 |
even though that makes them a little bit uncomfortable. 00:21:59.500 |
You said it makes the CFOs talking a little bit high pitches 00:22:02.980 |
and all that's true, but I think they've all determined 00:22:09.100 |
in something that has the very high potential 00:22:15.300 |
certainly it causes you to step back and say, 00:22:19.220 |
we've however, the past decade has been unprecedented 00:22:30.980 |
on their balance sheet has, was so unprecedented. 00:22:37.820 |
and like, what are they going to do with all this money? 00:22:42.940 |
where a hundred percent of incremental free cash flow 00:22:45.340 |
is now spoken for is a certainly a change, right? 00:22:49.020 |
And my friend, Mike Mosin would get mad at me 00:22:55.740 |
all that matters is not that they're using up 00:23:07.460 |
And that, this is the thing where I think that 00:23:12.220 |
in the first three to four years of a phase shift, right? 00:23:15.260 |
It's really hard for the traditional Wall Street analysts 00:23:25.220 |
you had 26 analysts on Wall Street covering NVIDIA. 00:23:37.220 |
I mean, it's just like, that's how wrong you can be 00:23:39.900 |
if you're thinking linearly at a moment of a phase shift. 00:23:44.140 |
And so I think there, we're still in that moment. 00:23:52.700 |
with the people who are actually doing these things. 00:23:55.740 |
Right, and seeing what they're actually building. 00:24:02.660 |
and so everybody could model it reasonably well. 00:24:05.820 |
But in 2012, 2013, right, when you're earlier on 00:24:09.580 |
in that phase shift, there was a real opportunity early 00:24:12.420 |
in those companies, Snowflake, Mongo, Okta, et cetera, 00:24:15.060 |
to do things that people thought were not possible 00:24:19.940 |
what you call the prisoner's dilemma argument. 00:24:27.580 |
And there's, by the way, let me ask a quick aside. 00:24:48.020 |
Are they entering the enterprise hyperscaler business? 00:24:55.660 |
I, you know, I take Mark at his words last year 00:25:01.940 |
they already charge license fees to the large hyperscalers 00:25:09.180 |
I think it's de minimis revenue in the scheme of Meta, 00:25:15.540 |
and people have found that there are searches, 00:25:18.780 |
you know, on, you know, for executives to come in 00:25:33.340 |
But they're smart enough to maintain the optionality bill. 00:25:40.940 |
to make them easier for some customers of NVIDIA. 00:25:43.580 |
So it would only make sense to me that, you know, 00:25:48.860 |
Let's include them for the sake of this question 00:26:06.660 |
they do it as a matter of their earnings call. 00:26:21.380 |
if Satya were to say 60 next year instead of 80, 00:26:26.020 |
does he have a concern that that's a perception 00:26:30.820 |
or that they're losing ground to other people 00:26:35.500 |
And therefore, you get into this kind of reflexive argument. 00:26:39.540 |
Like if we want to be perceived as leaders in AI 00:26:44.380 |
with confidence that we're gonna take our fair share, 00:26:55.420 |
Yeah, I mean, it would be fairly conspiratorial 00:27:01.020 |
just so that the optics are that they are our leaders. 00:27:12.140 |
and their inference revenues are going to accelerate 00:27:19.100 |
OpenAI has said publicly, Sam has said many times 00:27:22.500 |
that the reason that they can't release models widely, 00:27:25.700 |
they can't release some of the voice stuff that you wanted, 00:27:35.700 |
Part of the reason they charge higher prices for pro models 00:27:39.580 |
is because they have to artificially reduce the demand 00:27:44.300 |
And so I think across the board, there's compute constraint. 00:27:49.180 |
Number one, you have over 300 million people a week 00:27:54.900 |
instead of search or something else to answer my question. 00:28:02.380 |
inference time compute is a compute hog, right? 00:28:06.020 |
These things require huge amounts of compute. 00:28:11.260 |
we just don't have a compute infrastructure in 2024 00:28:15.300 |
And so I think the investments we're seeing in 2025, 00:28:18.340 |
frankly, I don't even think is going to get us to the point 00:28:23.060 |
I think we're going to end this year, compute constrained. 00:28:26.180 |
And I think a lot of the frontier labs feel the same. 00:28:31.780 |
You've seen Google release a high-end pay-for consumer, 00:28:36.780 |
you know, by consumer, I mean just a individual user 00:28:43.820 |
'cause it could be a consumer at a company as well, 00:28:48.900 |
And when Elon was talking about their release of Grok 2 00:29:00.620 |
and this to me is a positive outcome for OpenAI 00:29:10.580 |
they assume that the frontier is going to be free 00:29:19.420 |
with subscription pricing, that could start to get sticky. 00:29:31.060 |
and not have a robust business model behind it. 00:29:43.860 |
I think it was rumored four to five billion run rate 00:29:48.500 |
You know, you would expect a company at this stage 00:29:54.020 |
And so you start thinking about 10 billion plus in revenue 00:29:58.340 |
Now, compare that to some of the other companies, Bill, 00:30:00.540 |
right, Mistral, a lot of the other model companies 00:30:04.420 |
Like they've already raised their hand, white flag, 00:30:06.900 |
we don't have the revenues that can support the spend 00:30:10.780 |
It's going to be interesting to see what Anthropic does, 00:30:13.940 |
Their revenues are reported to be less than a billion dollars 00:30:22.980 |
And I would tell you that as large as Google is 00:30:30.660 |
and not have a business model to support the spend. 00:30:33.060 |
So what you're hearing would make sense to me. 00:30:35.820 |
One other thing I just want to say about this, Bill, 00:30:38.940 |
one of the things we've spent a lot of time on internally 00:30:43.980 |
of that compute demand relative to the compute supply. 00:30:52.020 |
that Jensen made and maybe we'll insert the clip here 00:30:54.460 |
on the pod where he talks about his inference revenue 00:31:16.860 |
that 2025 is going to be the year of agents, right? 00:31:24.020 |
and now you have deep reasoning out of Google 00:31:33.180 |
But the thing about those, Bill, as you well know, 00:31:37.740 |
The number of tokens that you have to produce, 00:31:39.900 |
that you have to repopulate back into the prompt, 00:31:42.500 |
the number of branches of inference that you go down, 00:31:54.020 |
long-term memory about each individual users, 00:31:57.940 |
and actions, book my hotel, book my, do things for me. 00:32:02.020 |
Again, those things are all compute consumptive. 00:32:04.620 |
So that's why I think the frontier labs like chat GPT 00:32:08.020 |
are modeling out that expected compute demand 00:32:19.180 |
but I want to finish the CapEx thing real quick. 00:32:26.100 |
we're looking at a slide, Google, Meta, Amazon, 00:32:28.460 |
Microsoft, Apple, and they're all spending this money. 00:32:31.540 |
And you can say, what does it mean for those stocks? 00:32:42.780 |
that they're going to spend this amount of money. 00:32:45.660 |
And the processes for spending that amount of money 00:33:06.140 |
how do we think about the framework for the year? 00:33:16.300 |
So think of that bill as all your chips on the table. 00:33:22.140 |
We started last year, I think around 80% net long. 00:33:31.300 |
and if you think all this money's being spent, 00:33:32.940 |
then why the hell do you have fewer chips on the table? 00:33:34.780 |
And I just told you, valuations are a lot higher. 00:33:39.500 |
Warren Buffett has told us the most important thing, 00:33:41.380 |
Charlie Munger, the most important thing in investing 00:33:54.660 |
what I say is there's gonna be a lot of FX headwind, okay? 00:33:57.660 |
So the strength of the dollar has gone up a lot. 00:34:08.860 |
And then secondly, their CapEx is going up a lot. 00:34:16.380 |
that the CapEx is higher than people think, okay? 00:34:19.260 |
So both of those things aren't particularly good 00:34:23.500 |
for the biggest companies trading at high valuations. 00:34:26.220 |
Now, I don't think it's gonna cause some cataclysmic event, 00:34:36.740 |
Yeah, well, first I wanna show a slide on NVIDIA 00:34:53.300 |
and Jim Cramer was telling everybody, sell it, 00:34:55.060 |
it's up two X, and then three X, sell it, it's up. 00:35:02.180 |
It went up a lot because its earnings went up a lot. 00:35:04.300 |
It went up a lot because its revenues went up a lot. 00:35:07.860 |
that just shows the consensus data center revenues, 00:35:14.780 |
And the key here is to remember that NVIDIA prior, 00:35:19.420 |
you know, data center revenues are mostly, you know, 00:35:22.140 |
these chips that are driving training and inference. 00:35:24.860 |
And this is a business that's got very high margins on it. 00:35:31.780 |
In 2025, it's estimated to be close to $200 billion. 00:35:36.540 |
And so if you notice the jump between '24 and '25, 00:35:41.140 |
that is about a $60 billion increase, '24 to '25. 00:35:47.220 |
that we just went through, that's $60 billion, right? 00:35:56.380 |
Most of this stuff is NVIDIA wall-to-wall in 2025. 00:36:00.460 |
You know, Jensen told you at CES, he's got 40 AI factories. 00:36:08.980 |
So I actually think if you look at the consensus numbers, 00:36:11.900 |
they probably would imply that NVIDIA's market share 00:36:15.420 |
is going down '24 to '25, and I don't think that to be true. 00:36:25.700 |
And your expectation of what percentage of that-- 00:36:27.660 |
Correct, and remember, NVIDIA's stock has not gone up 00:36:44.420 |
So people say, maybe you don't need all these chips. 00:36:56.940 |
from more spend on inference than pre-training, 00:37:01.780 |
do you need this big, large, holistic cluster? 00:37:15.940 |
Of course, they can't ramp to anywhere near this scale 00:37:24.060 |
that, you know, they're spending a lot on GPUs, 00:37:33.100 |
Well, NVIDIA's clearly, you know, high on that list. 00:37:38.660 |
140, 150% last year, but Intel was down over 20%, 00:37:58.180 |
So SK Hynix, which is providing high-bandwidth memory, 00:38:03.660 |
particularly in a world of inference time compute. 00:38:12.140 |
supercomputer ecosystem, as far as we can see. 00:38:16.180 |
So Micron and SK Hynix would be in that memory space. 00:38:23.460 |
So when you look at companies like NVIDIA, you know, 00:38:28.460 |
or others that are doing well in this environment, 00:38:34.020 |
would suggest everyone understands that and buys into it. 00:38:39.900 |
SK trades at like six times forward earnings, 00:39:02.740 |
Yeah, no, I think the reason it has that multiple 00:39:09.340 |
it's commodity memory, that it's a boom and a bust, 00:39:12.060 |
and that they don't add a lot of kind of sticky value 00:39:16.100 |
that you can just easily put on a lot more supply. 00:39:19.180 |
That supply will ultimately drive down the cost 00:39:22.420 |
and the margins, and that demand is cyclical. 00:39:40.100 |
but the second one is you could have a re-rating higher 00:39:42.620 |
in terms of the multiple people are willing to pay. 00:39:52.580 |
you and I talked a lot around the Diablo episode last year, 00:39:55.860 |
just, you know, we have power issues in this country, right? 00:39:59.180 |
And so who, how are we going to power up, you know, 00:40:07.700 |
Because remember, if they're spending this money, Bill, 00:40:32.740 |
that we're not putting online 'cause we can't power. 00:40:43.300 |
And we, I'm very focused in talking to our friend, 00:40:47.460 |
David Sachs and others in this administration. 00:40:58.940 |
We know China's building 100X as much as we are 00:41:03.140 |
and power is the single most important primitive to AI. 00:41:08.180 |
Gavin Newsom still has not signed the extension 00:41:23.580 |
so that they can begin doing the appropriate planning. 00:41:26.380 |
Hell, you and I think they should probably be expanding it. 00:41:29.940 |
the idea that you would take 10% out of the grid at a time 00:41:33.660 |
that we are already capacity constrained is totally insane. 00:41:38.580 |
So Altimeter's historically been tech-focused. 00:41:42.780 |
Do you, when your information leads you this direction, 00:41:46.620 |
do you start moving in and out of energy companies? 00:41:51.540 |
Well, I'll tell you, a lot of my tech peers have, right? 00:41:54.340 |
And if you look at some of the highest returning companies 00:42:01.900 |
they were in fact companies in the energy space. 00:42:09.260 |
Altimeter North Stars is essentialism, right? 00:42:12.900 |
Like just don't make anything any more complex 00:42:21.300 |
I would say, why is that better than NVIDIA, right? 00:42:24.260 |
It's a derivative of NVIDIA, it's the exact same bet. 00:42:29.140 |
So we tend to just take bigger bets on our best ideas 00:42:33.780 |
rather than diversifying out into these other things 00:42:39.220 |
I do know that we need a lot more power, Bill, 00:42:43.980 |
exactly how the regulatory is going to play out, 00:42:47.020 |
exactly how, whether these small nuclear reactors, 00:42:54.460 |
and if you don't know who it is, it might be you. 00:42:58.580 |
You know, one of the things we ought to come back to, 00:43:11.940 |
And how do I think that may or may not change? 00:43:22.900 |
just over the course of the last couple of months, 00:43:29.540 |
This, despite the fact that inflation has largely, 00:43:33.580 |
you know, like, remember, just a couple years ago, 00:43:38.900 |
And I remember when I said, a couple years from now, 00:43:40.980 |
we'll be back to a two handle, people laughed. 00:43:46.060 |
And if you look at the Morgan Stanley consensus forecast 00:43:49.420 |
for this year, they expect it to finish the year at 2.2. 00:44:00.500 |
And I think there are a few things at play here. 00:44:03.220 |
Number one, the Trump election got people really excited 00:44:11.460 |
And you're gonna have 400 billion of stimulus 00:44:23.060 |
Regulatory relief will stimulate the economy. 00:44:28.420 |
A lot of people are concerned it could reignite inflation. 00:44:36.420 |
And if it does, rates are not gonna be able to go lower. 00:44:43.420 |
has gone from a lot of rate cuts to only one rate cut 00:44:49.740 |
So basically the market's saying that there's too much, 00:44:58.380 |
there's gonna be a lot of tension back to that core PCE. 00:45:13.100 |
and this is something I know you and I are close to, 00:45:18.820 |
the market is saying we expect this stimulus to come in, 00:45:24.300 |
but I think it's also saying we do not expect Congress 00:45:27.120 |
to have the courage to cut an equivalent amount 00:45:33.500 |
if we have 400 million of tailwind from this tax stimulus, 00:45:36.740 |
then I think what the market would like to see 00:45:56.040 |
Trump has talked about interest rates being too high. 00:45:58.740 |
He talked about it at the press conference the other day. 00:46:05.260 |
I think they'll say, these are the issues that are at play, 00:46:13.520 |
They've told us, in a single reconciliation package, 00:46:20.580 |
This is the backdrop that is going to impact valuations 00:46:24.700 |
that we have to grapple with, we have to try to understand. 00:46:35.660 |
are actually going to cut a lot out of the budget. 00:46:39.380 |
And, you know, I think that you have the leadership 00:46:43.760 |
And so if they cut hundreds of billions of dollars 00:46:47.760 |
then I think the market will say, great, fiscal discipline, 00:47:24.340 |
I think it's important to try to get our arms around 00:47:29.500 |
Is it even possible to cut three or $400 billion 00:47:42.700 |
by the federal government in 2019 was $4.4 trillion. 00:47:50.100 |
Social Security, we spent a trillion dollars, 00:47:52.620 |
Medicare, 644 billion, Medicaid, 409 billion. 00:47:57.620 |
You can see the different categories under that, 00:48:01.780 |
And you can see what our net interest expense was 00:48:03.840 |
at the time because interest rates were relatively low, 00:48:09.380 |
The next column is what we actually spent in 2024. 00:48:34.260 |
We went back to 2019 and we grew every category 00:48:40.620 |
We said the GDP's growing at two and a half percent, 00:48:46.900 |
so that's what government spending should roughly grow at. 00:48:49.860 |
And if you see there, the baseline 2019 budget 00:49:11.060 |
this is, I think, really what has people optimistic, 00:49:26.260 |
There are some proposals, and I'll post this proposal, 00:49:30.580 |
here's $700 billion of easy deficit reduction 00:49:34.100 |
that both Democrats and Republicans agree on over 10 years. 00:49:37.420 |
So that doesn't get us there, but it is certainly a start. 00:49:40.860 |
But I think this is gonna be critically important 00:49:45.580 |
that we get our arms around federal spending this year, 00:49:50.100 |
is the biggest potential boogeyman out there. 00:49:52.500 |
And there are ways that Trump can potentially 00:49:54.300 |
do some of this unilaterally, through rescission, 00:49:59.820 |
and just refusing to spend what Congress allocates. 00:50:07.540 |
I think that, you know, I'm expecting, and I hope, 00:50:11.260 |
that we see cuts that at least offset the tax cuts. 00:50:35.260 |
And so it may require you to attack that specific problem 00:50:42.740 |
not just, you know, say we're gonna spend less. 00:50:51.140 |
that you and I, you can look at any population chart 00:51:00.780 |
and the number of new people coming into the workforce 00:51:09.920 |
that is paying taxes to pay for all of these things 00:51:14.280 |
So demographically, that is going to be challenged, 00:51:17.160 |
but, you know, so how do you deal with it, right? 00:51:21.000 |
Well, you can either just give less things to the people 00:51:27.520 |
or you can come up with more efficient delivery mechanisms. 00:51:31.020 |
Obviously, we know all of the easy and crazy (beep) 00:51:35.380 |
that Doge has been talking about that we can cut. 00:51:47.100 |
and you really have to go through every category. 00:51:49.900 |
And if you zero base this, I tend to be where, 00:52:06.240 |
then there's a real risk that the bond vigilantes 00:52:09.540 |
come into the bond market, you end up with higher rates, 00:52:19.800 |
in American life that the government's inefficient. 00:52:33.540 |
They might argue that it has to exist regardless, 00:52:41.340 |
Elon said it's like shooting fish in a barrel 00:52:53.900 |
if you find policy that's restrictive and unnecessary, 00:53:03.940 |
And I totally agree with you that the inhibitor here 00:53:07.700 |
won't be the identification or knowing what to do, 00:53:12.540 |
it'll be whether the system can actually reform itself. 00:53:18.820 |
I mean, like, you know, we'll put in here the charts 00:53:25.740 |
But it is just not that hard to get to a balanced budget 00:53:31.100 |
That's 1 trillion above what we should be spending 00:53:37.420 |
But it just gets you back to that 2019 baseline, right? 00:53:41.020 |
And it assumes that we have some acceleration, 00:54:03.460 |
like the US is in such an incredible position. 00:54:07.220 |
We just have to have the courage of our conviction 00:54:18.060 |
because I know there's an AI bill brewing down in Texas, 00:54:22.260 |
akin to California's 1047 that we got killed. 00:54:44.820 |
Well, you and I have talked about this in the past, 00:54:56.580 |
where people are literally begging for regulation. 00:54:59.780 |
And that got a bunch of different parties up on both sides, 00:55:06.500 |
people believe part of those efforts led to the Biden-EO. 00:55:09.940 |
And they also led to this big push in California, 00:55:16.260 |
1092, that everyone got on one side or the other. 00:55:20.940 |
Everyone in our community had a point of view. 00:55:27.220 |
inside the administration in California pushing for that. 00:55:31.220 |
And it ended up with this huge, you know, argument, 00:55:36.940 |
And I suspect that most people see administration change, 00:55:42.060 |
or friend David Sachs coming in as the AIs are, 00:55:51.260 |
What's happening, and people are probably not aware of, 00:55:54.100 |
is that the people pushing for this regulation 00:56:00.660 |
and they're pushing it in a bunch of different states. 00:56:08.660 |
And I guess this is how policy works in this country. 00:56:19.620 |
that's got kind of the most heat right now is in Texas. 00:56:26.700 |
and all his companies have had this massive impact 00:56:34.580 |
that's kind of the most pro-innovation and pro-business. 00:56:56.940 |
Well, now those words sound stupid, because Texas, 00:57:00.460 |
and the first thing that people should realize 00:57:04.700 |
is there's no reason to do this on a state-by-state basis. 00:57:11.380 |
he had this initiative that he didn't get around to, 00:57:26.460 |
And for us, when so many people in Washington 00:57:30.540 |
are worried about our competitive position versus China, 00:57:48.060 |
you know, I wanna say the word stupid out loud, 00:57:54.540 |
is that like someone trying to write that legislation 00:58:08.780 |
I prefer it at a national level to a state-by-state. 00:58:17.420 |
our great advantage over Europe is, you know, 00:58:23.220 |
And here, if you're operating an internet company, 00:58:27.500 |
And we need to have one rule of the road around AI. 00:58:32.860 |
and will be promulgated in the federal level. 00:58:37.820 |
that people are like, oh, everybody in Silicon Valley, 00:58:48.560 |
to uninformed regulation that would slow us down 00:58:53.140 |
and cause us to lose an important race to China. 00:59:02.820 |
to us running the fastest race we can run, right? 00:59:11.500 |
while still caring about all of these things. 00:59:20.420 |
all you're doing is handing the gold medal to China. 00:59:25.180 |
And so I think the unintended consequences are really bad. 00:59:38.140 |
of everything that's wrong with the Texas proposal. 00:59:45.500 |
So this is, you know, similar to like creating an audit 00:59:49.940 |
and, you know, for those of you who've run companies 00:59:52.720 |
who've gone through audits, you know how difficult it is. 01:00:07.300 |
And then there's liability associated with it 01:00:10.540 |
And so if I do something bad, I'm liable for it. 01:00:18.560 |
where I should have known about the risk that's there. 01:00:21.540 |
And it's like, and it applies, you know, very broadly. 01:00:28.620 |
that are looking for regulatory capture credit 01:00:34.900 |
and realized that they could create messy anxiety 01:00:43.420 |
may actually promote trying to get to a national, 01:00:51.640 |
I think they're going to get a lot of pushback. 01:00:53.160 |
I'll be very, I would be shocked if this happened in Texas. 01:01:10.200 |
who was a co-chair of the AI committee in the house. 01:01:17.120 |
and provide a really clear coordinating function 01:01:23.560 |
and that we'll get great direction, you know, 01:01:28.800 |
is I'm just thinking about 2025 predictions, you know, 01:01:37.560 |
and a lot of it directed at open AI that, you know, 01:01:40.880 |
these models, these companies with a closed model 01:01:49.120 |
trying to squash what was happening in open source. 01:01:54.760 |
a lot more companies open source more of their models. 01:02:23.480 |
But that's a, what I'm hearing out of a bunch of them 01:02:26.000 |
is that we're gonna see a bunch more open source. 01:02:30.600 |
So you could be right that the bigger companies 01:02:36.480 |
There's also the issue of small versus large. 01:02:40.920 |
And, you know, there's a lot to pay attention to there. 01:02:45.920 |
Before we wrap up, I had like four or five things 01:02:52.000 |
and get your opinion on as I look forward into the year. 01:02:56.160 |
The one that I've been thinking about a lot is Google. 01:03:04.520 |
And clearly for those of us that are doing so many searches 01:03:09.320 |
first on a chat GBT or other product like that, 01:03:25.760 |
we've said, man, they have an incredible number of assets. 01:03:37.040 |
and then their Slack-like competitive products, 01:03:50.920 |
I was, you know, surprised to hear Jason on All In 01:03:59.560 |
and then announced that he had switched to a Pixel phone. 01:04:05.360 |
this could be kind of the perfect AI basket of assets. 01:04:10.320 |
And, you know, you look at a company like Glean, 01:04:15.520 |
You know, you can create Glean for the rest of us 01:04:18.880 |
if a company commits to being on the Google stack 01:04:23.680 |
And it becomes a combination that no one else has. 01:04:27.520 |
Apple doesn't have it, Microsoft doesn't have it. 01:04:30.360 |
It requires insanely great execution to get it all right. 01:04:41.960 |
that I'm gonna switch from my iPhone and get onto Android, 01:04:56.080 |
I started seeing a bunch of breadcrumbs around Gemini, 01:05:03.840 |
just the cycle time, you know, improving there. 01:05:10.760 |
in their search volumes, you know, their lead generation. 01:05:14.040 |
So online travel companies, et cetera, from Google. 01:05:16.880 |
And I started to see a lot more evidence of them 01:05:18.840 |
just, you know, getting fit and getting more efficient. 01:05:21.600 |
And frankly, I think a lot of credit goes to Sundar. 01:05:32.480 |
They are facing the largest innovators dilemma 01:05:34.680 |
in the history, and certainly from my perspective, 01:05:40.040 |
to replace a 99% incremental margin business, 01:05:43.320 |
i.e. a monopoly search business with whatever comes next. 01:05:46.360 |
Because whatever comes next, they may be important in it, 01:05:49.440 |
but they're not going to be 99% monopolies, right? 01:05:56.200 |
So, and I don't think their margins are going to be the same. 01:06:13.120 |
then all these things could really replace that. 01:06:15.760 |
I think you have plenty of time to wait and see, 01:06:39.560 |
that they've worried that Google could appropriately embed 01:06:43.480 |
Gemini and deep reasoning and a search, you know, 01:06:47.240 |
an assistant on the phone that can book my hotel, 01:06:51.400 |
I'll tell you another area where they have an advantage, 01:06:54.320 |
which is hopefully useful to everyone out there. 01:07:02.680 |
So I find myself now if I'm going to a restaurant, 01:07:26.800 |
A second one that I think is super interesting to me 01:07:29.120 |
that we're going to see play out first half of this year, 01:07:32.000 |
X.AI, Elon's commitment to the largest cluster. 01:07:40.720 |
the concerns about maybe there's a parameter limit, 01:07:44.160 |
at least against the text data set draws into question, 01:08:02.640 |
that is competitive with the cutting edge at OpenAI 01:08:07.560 |
I don't know, but I'm very curious about how that plays out. 01:08:11.000 |
I mean, I think there's been a lot of attention 01:08:14.920 |
I'm not sure that I would measure X.AI's success 01:08:21.640 |
solely on the dimension of, is the Grok 3 model 01:08:24.720 |
better than whatever OpenAI's latest is or Gemini? 01:08:28.200 |
Because remember, what they're doing really, Bill, 01:08:36.920 |
with post-training and test-time compute, et cetera. 01:08:42.600 |
I think it's a test of that pre-training argument. 01:08:55.920 |
I think, here's the way I think about X and Elon. 01:09:00.200 |
He's got three vectors on which he is leveraging AI. 01:09:11.920 |
that he expects there to be millions of humanoids 01:09:29.440 |
because humans were confused whether or not it was real. 01:09:37.880 |
And I picked up a new Tesla S at the end of last year 01:09:40.160 |
with hardware for just so I could be on the latest of FSD. 01:09:42.960 |
It drove me home from San Francisco last night. 01:09:45.240 |
So those are two real world, like not language models. 01:09:48.600 |
Now we're talking in the world of bits and, you know, 01:09:57.520 |
just because those are in separate companies, 01:10:11.760 |
of companies that can leverage each other's insights. 01:10:16.360 |
And X.AI, so his need to build these large clusters 01:10:21.360 |
and place these bets is because he's got to support 01:10:26.360 |
huge potential businesses, not just building Grok 01:10:35.480 |
But he has lots of ways that he can leverage it. 01:10:37.360 |
And remember, if you build a large coherent cluster 01:10:43.320 |
okay, we're hitting up against some scaling limits 01:10:59.000 |
is that these guys are going to spend a lot of money 01:11:08.160 |
that demand machine learning and accelerated compute. 01:11:17.400 |
It seems to me that X.AI wants to make the argument 01:11:33.160 |
Well, I think it's not necessarily owning it or having it, 01:11:46.040 |
that doesn't have as many hiccups in productions, et cetera, 01:11:52.680 |
talk about this crazy timeline that Elon hit. 01:11:59.960 |
and an ability to raise global capital, Bill, 01:12:02.640 |
that his cost of capital is really low for doing this. 01:12:19.520 |
It's part of the reason I'm so bullish on Team America 01:12:24.480 |
because we've got the smartest people in the world 01:12:28.520 |
invested in anything other than perhaps the Apollo project 01:12:39.400 |
You gotta have the best research in the world. 01:12:41.040 |
Like you can have the best computers and chips 01:12:46.400 |
around your reasoning model and the other guy does, 01:12:53.960 |
Number three, I don't recall in any of the previous waves, 01:12:58.960 |
you know, PC wave, client-server wave, mobile wave, 01:13:13.440 |
where he said, "Oh, I already have my own models," 01:13:18.600 |
you know, implying that they're in some kind of co-opetition 01:13:26.240 |
talk about doing their own processors of some sort, 01:13:32.360 |
and then the TPU at Google compete with NVIDIA, 01:13:41.920 |
And then they announced this AI-driven PC unit, 01:13:46.920 |
which would, you know, presumably compete with Dell, 01:13:58.440 |
at least I think about the Wintel, you know, world, 01:14:04.320 |
I just felt more like people stayed in their lane 01:14:07.160 |
and were thankful to be a part of this broad ecosystem 01:14:46.320 |
was going to be, you know, a nuclear level of capital, 01:14:55.440 |
but they couldn't be totally dependent upon them. 01:15:00.840 |
and you had Amazon that made a bet on Anthropic, 01:15:05.080 |
And now as these companies become big and successful, 01:15:07.720 |
like, listen, if they don't become big and successful, 01:15:15.840 |
But if they get some scale on their own, like OpenAI, 01:15:29.360 |
I think the competition is as aggressive as it's ever been. 01:15:32.800 |
I think sometimes we make more out of this competition 01:15:41.800 |
I don't think they intend to be in the frontier model game 01:15:45.480 |
where they're competing heads up with these other folks. 01:15:47.480 |
At the same time, there's a long tail of their customers 01:15:50.360 |
who are more than satisfied to use a tightly coupled model 01:15:54.400 |
rather than maybe trying to kludge it together themselves 01:16:01.680 |
And so, you know, we'll have to wait and see. 01:16:05.320 |
Here's one thing that I would just point out in that regard. 01:16:16.080 |
being spent by the biggest companies in the world 01:16:21.880 |
to advance causes that are aligned with America, right? 01:16:29.280 |
and where you had national government spending. 01:16:31.720 |
And I just think this is so damn bullish for us 01:16:39.520 |
to invest this much money to put us at the bleeding edge 01:16:43.480 |
and it creates incredible national strategic advantage. 01:16:50.440 |
Now that people said they don't have any use for this cash, 01:17:10.440 |
the majority of the enthusiasm on the advancement in AI 01:17:20.280 |
I think it's somewhat ironic that it's less efficient, 01:17:28.480 |
to where the margins expanded, that would be better. 01:17:31.240 |
But okay, so now the argument is it's less efficient, 01:17:40.720 |
to different uses of AI will be super interesting. 01:17:44.440 |
So, you know, what are the coding companies seeing, 01:17:56.120 |
even OpenAI said it's not for every use case, 01:17:59.000 |
or they hadn't seen it be successful in every use case. 01:18:01.800 |
Now, maybe they will in the future, you know, 01:18:03.440 |
and I've signed up and paid for all these pro versions now 01:18:07.600 |
in the past few weeks, been throwing problems at, 01:18:10.920 |
you know, especially the one that's interesting 01:18:13.840 |
You know, both the Google and the OpenAI products, 01:18:18.920 |
So, and is, you know, how much better is that output? 01:18:28.240 |
Obviously, if the compute price keeps falling, 01:18:31.480 |
I think you fall into this, why not argument? 01:18:37.200 |
if the marginal cost gets somewhat irrelevant? 01:18:47.960 |
maybe you can get the smaller model to run, you know, 01:18:51.400 |
the second, you know, double-checking your work, 01:18:55.360 |
But anyway, this, I think this will be the fun part 01:19:11.560 |
and they're surprised how skeptical the world is. 01:19:29.440 |
you know, they're seeing things ahead of time. 01:19:57.080 |
just because you throw more compute at 'em as well. 01:19:59.640 |
So where are we on that scaling curve for reasoning? 01:20:02.640 |
Most of 'em tell me that we're around a Chad GPT 2.0 01:20:19.720 |
so where are these things going to be put into practice? 01:20:25.480 |
some pretty dramatic breakthroughs this year on coding, 01:20:36.680 |
kind of get these agents to do things that they want. 01:20:39.240 |
I think you're going to see real coding agents 01:20:55.120 |
And I would say secondly, so if at the enterprise level 01:20:58.920 |
you think of coding as kind of the tip of the spear 01:21:17.560 |
And I imagine the same happens with Gemini, et cetera. 01:21:23.280 |
one of my partners did a demo using booking.com 01:21:26.280 |
and the anthropic computer use where, you know, 01:21:31.120 |
It's still fairly embryonic, but I think that, 01:21:45.000 |
I think now the use case is very narrow, it's researchers. 01:21:48.120 |
Okay, but I think you're going to see the aperture 01:21:51.240 |
on the reasoning models expand pretty dramatically. 01:21:57.360 |
a blending of the pre-trained and the O series model, 01:22:06.680 |
do all the things that you want to have done. 01:22:08.440 |
Well, here's, I didn't discuss this with you ahead of time. 01:22:18.640 |
that are doing particularly interesting things 01:22:20.960 |
or leveraging this in a particularly interesting way, 01:22:28.440 |
but be obviously willing to share with the audience 01:22:35.360 |
I'll close with this and you didn't ask for my input on it, 01:22:42.600 |
and that I think it falls in the too hard bucket 01:22:45.120 |
because of all the different variables at play. 01:22:49.920 |
And I look forward to a fun year of doing these 01:22:53.240 |
And, you know, I learned a lot kicking around with you.