back to indexWhen Should You Pay Off Your Mortgage Early?
Chapters
0:0 Intro
4:20 The relationship between bonds and rates
9:55 Is the market already pricing in rate cuts for 2024?
15:33 Pros and cons of paying off a mortgage
21:41 Dealing with single-stock concentration
28:47 Thoughts on Tax-loss Harvesting
00:00:16.520 |
I made that number up, but it's gotta be pretty close. 00:00:18.560 |
- Okay, I was about to say, wow, you counted. 00:00:46.840 |
they have the gym shorts, they have the khaki shorts. 00:00:48.640 |
These are the khakis, 'cause they have the little belt loops. 00:00:57.120 |
I liked the mint green, and I don't know, is it salmon? 00:01:04.560 |
- I don't mind taking bold colors in the summer. 00:01:14.960 |
for the summer, for spring break, all that kind of stuff. 00:01:19.680 |
Also, still, and I think I got a free T-shirt 00:01:26.160 |
But with us, you can still get the free white Tech Dad hat. 00:01:44.760 |
I actually was talking about bird dogs with someone. 00:01:47.360 |
Someone, for real, like completely unprompted, 00:01:53.040 |
Or I guess they saw the logo on what I was wearing. 00:01:59.520 |
And they're like, "Oh, I keep getting targeted advertising 00:02:28.080 |
- Yeah, we've been getting a lot of that on social media, 00:02:41.200 |
but we had hundreds of people with us in their top 10, 00:02:49.160 |
Our best show of the year, do you have any guesses? 00:03:00.040 |
Okay, I would have never even guessed what it could be. 00:03:20.440 |
where we make jokes about everyone's favorite 00:03:37.520 |
All right, John, show the year-to-date return, though. 00:03:39.800 |
So, before the show, Duncan actually asked John 00:03:43.000 |
to pull up the chart of Oatly on a year-to-date basis, 00:03:46.360 |
"Wait, wait, wait, this is not what I wanted to see." 00:03:51.200 |
Pull a good chart, and it's over the one month. 00:03:57.360 |
- All time, so this is down 94% from the IPO. 00:04:08.360 |
I basically bought it every point along that. 00:04:27.600 |
Yeah, I've had multiple people reach out and be like, 00:04:33.960 |
So, up first today, we have a question from Dave. 00:04:48.480 |
- All right, we've still been getting a heavy influx 00:05:09.520 |
So, I think people who've made that move into cash, 00:05:12.440 |
and it went from earning 10 basis points at their big bank 00:05:16.340 |
to at least earning four or five, maybe more, percent 00:05:19.320 |
in T-bills or savings account or money markets, 00:05:21.800 |
they've made that leap, but now they're saying, 00:05:26.380 |
So, our friends at the US Benchmark Series of ETFs 00:05:29.700 |
send us this monthly update, which is pretty cool. 00:05:34.340 |
So, this is an interest rate scenario analysis tool. 00:05:37.540 |
And, of course, different bonds have different maturities 00:05:41.980 |
and the yield curve never moves exactly the same. 00:05:45.340 |
You don't have a 1% move in every single maturity. 00:05:48.340 |
A lot of times these bonds move in different forms 00:05:54.180 |
So, what Benchmark Series did for us is they looked at 00:05:57.060 |
what would happen over a 12-month period to these bonds, 00:06:02.020 |
five, seven, 10, 20, and 30-year treasuries, right? 00:06:06.340 |
What would happen if rates rose 50% or fell 50 basis points? 00:06:15.300 |
So, the 30-year treasury, if rates were to fall 1%, 00:06:23.180 |
If rates were to rise 1%, it's down a little less than 10%. 00:06:27.340 |
Now, there's this funny term in the bond market land 00:06:33.620 |
because that sounds like a very scientific word, 00:06:38.680 |
if bond yields fall, your price is gonna rise more 00:06:47.860 |
But the other thing, throw this back up here, John. 00:06:49.940 |
The other thing to look at is a shorter-term bond, 00:06:52.660 |
if rates were to fall 1%, you can see the two-year, 00:06:55.500 |
it rises 5%, and most of that is the yield right now. 00:06:58.380 |
So, you're not gonna get as big a bang for your buck 00:07:00.660 |
if yields were to fall in something of a shorter-term bond, 00:07:03.940 |
just like you're not gonna see as big of losses, right? 00:07:08.460 |
So, you do have this interesting dynamic now, though, 00:07:12.780 |
where if rates rise, your loss is gonna be not that bad, 00:07:17.460 |
and if rates fall, your gain is gonna be pretty good, 00:07:20.140 |
which was the opposite of what things were like 00:07:22.460 |
a few years ago during the pandemic when rates were so low. 00:07:26.940 |
You have this convexity piece where if yields fall, 00:07:29.820 |
you're gonna get a pretty big gain in your bonds, 00:07:34.060 |
you're still, you have some shock absorbers there. 00:07:37.620 |
- So, wait, you're saying I should tax-loss my OBLY 00:07:43.860 |
I mean, rates have already fallen a little bit, 00:07:45.860 |
but this is the problem with trying to guess this 00:07:52.260 |
how much are they gonna fall in the third year 00:07:54.940 |
we don't know what the magnitude of that fall is going to be 00:07:58.420 |
'cause the variables there are what's the Fed doing, 00:08:00.980 |
what's the economy doing, what's inflation doing, 00:08:05.780 |
So, the helpful thing about a chart like that 00:08:08.420 |
is it shows you what the potential outcomes can be, 00:08:21.480 |
So, if you want bigger bang for your buck if rates fall, 00:08:28.700 |
and if rates rise a little bit, you're gonna ding more, 00:08:36.540 |
- I think people sometimes paint the bond market 00:08:38.940 |
as being very mathematical and easier to predict 00:08:42.740 |
than the stock market, but this doesn't really sound like it 00:08:48.000 |
- Someone picking rate times to hike or cut or pause. 00:08:54.100 |
because over the long term, call it five to seven years, 00:08:58.220 |
your starting yield is gonna explain 90 to 95% of your gain. 00:09:14.660 |
So, I talked about this earlier this week on my blog. 00:09:17.440 |
The 10-year treasury went from a low to 3.3% this year, 00:09:24.940 |
and then in the past month, it's gone from 5% to 4.1%, 00:09:28.140 |
and no one could have predicted that path of rates. 00:09:34.380 |
or economic growth or whatever, good luck with that. 00:09:36.740 |
That's why bonds are generally for longer-term people 00:09:46.260 |
So, I would think about it more from the perspective 00:09:52.500 |
- Got it, makes sense. - All right, next one. 00:09:56.580 |
- Okay, up next, I wonder, actually, question on that. 00:10:11.940 |
is one of the things that cause a lot of people 00:10:16.860 |
- We're doing an ask the compound sentiment indicator. 00:10:22.740 |
Sure, it's great that S&P 500 is up 20% this year, 00:10:29.980 |
Should we really expect the market to go up again next year 00:10:38.020 |
and take a bit of an anti-bin stance about the markets. 00:10:48.300 |
was the greatest selling album musician of all the '90s, 00:10:53.180 |
- I remember that from the Chuck Klosterman book, 00:11:01.460 |
he tried to have a rock star persona of Christopher Gaines. 00:11:10.880 |
and he put a wig on and had his hair go over his eyes, 00:11:18.720 |
So I'm thinking maybe I should do that as the anti-bin, 00:11:29.720 |
and I think of it like his name was Chris Gaines, 00:11:37.860 |
- I turn into a perma-bear, I don't know, once a week. 00:11:44.220 |
and the United States financial system, as we know it, 00:11:53.060 |
- I'll start a newsletter, just full-time perma-bear. 00:11:58.460 |
I appreciate that, if that's your natural inclination, 00:12:03.720 |
Maybe the stock market is pricing in Fed cuts, 00:12:09.800 |
I do like to look at historical market returns 00:12:12.800 |
'cause I think what this person is asking is, 00:12:20.640 |
One of my favorite all-time stats of the market 00:12:22.540 |
is the fact that over the past 100 years or so, 00:12:29.780 |
So not including this year, there's been 34 gains of 20%. 00:12:36.740 |
Okay, so what happens the year after a 20% or more gain, 00:12:41.900 |
You can see there's way more green on this screen 00:12:47.740 |
So 22 out of the 34 years that we experienced a 20% gain, 00:13:07.260 |
There was 19 double-digit up years following a 20% gain. 00:13:15.340 |
Every single one of those years was a 20% gain. 00:13:23.580 |
So 2021 was a big, I think we were up 28 or 29%. 00:13:31.100 |
So we are teetering on the edge of a 20% gain this year. 00:13:34.720 |
We'll see if Santa comes through by the end of the year 00:13:36.160 |
or not and hold onto it, but you can do the chart off, John. 00:13:42.960 |
are actually pretty decent, and I guess kind of average, 00:13:48.000 |
There's actually a few more losses in there than gains. 00:13:57.120 |
I looked at the average return from one year to the next 00:14:02.520 |
When stocks are up big, so call it 15% or more. 00:14:15.520 |
There's more, you know, one year doesn't impact the next. 00:14:19.280 |
I'm sure you could slice and dice the data a little bit 00:14:32.760 |
But I just think you can't really be smart enough to say, 00:14:38.920 |
And we're gonna see a Chris Gaines phenomenon 00:14:51.080 |
that have never happened before in the stock market 00:14:54.720 |
So I think it's just important to prepare yourself 00:15:05.960 |
is most of the time the stock market goes up, 00:15:10.120 |
- Do you think perma bears always pick the underdog? 00:15:19.040 |
- I mean, I've basically been a perma bear my whole life 00:15:23.360 |
- Okay, so when it comes to sports, you're a perma bear. 00:15:37.320 |
Before 2022, I was adamant about not paying off my mortgage. 00:15:41.340 |
I thought it was a mistake to pay off my previous home 00:15:51.640 |
The higher interest rate makes each payment more costly 00:16:01.120 |
especially for folks in high tax states like me, 00:16:07.460 |
making the mortgage tax deduction less beneficial. 00:16:10.360 |
I'm curious to hear Bill Sweet's thoughts on all of this. 00:16:19.400 |
Bill, I think this email was actually came to my inbox 00:16:23.120 |
and it was, I wrote a blog post a couple of weeks ago 00:16:31.880 |
What do you think in terms of the tax part of it here? 00:16:34.440 |
'Cause a lot of this seems to make sense to me. 00:16:41.640 |
Really, John's question has to do with tax deductions 00:16:45.120 |
And Ben, I find that mortgage interest deductions 00:16:47.480 |
for tax purposes, they're generally overrated 00:16:50.280 |
and John kind of alluded to why in the question. 00:16:53.120 |
So I wanna talk through a little bit of how it works 00:17:02.840 |
For those at home, the 2017 standard deduction was $12,000. 00:17:14.000 |
any tax deductions relating to mortgage interest 00:17:35.820 |
we would need to deduct more than about $13,000, 00:17:41.200 |
in order to exceed that standard deduction threshold. 00:17:44.400 |
In other words, for this example I've illustrated here, 00:17:57.600 |
And to put that into terms, John, can we kill the chart? 00:18:05.860 |
I'm gonna borrow 300K and pay $24,000 to do that, 00:18:10.220 |
and I really only get a $2,000 tax break for it, right? 00:18:14.340 |
especially people on the coast complain about, 00:18:20.100 |
Yeah, throw it up on the whiteboard behind me. 00:18:32.580 |
everybody gets a standard deduction for free. 00:18:37.020 |
So it would increase the relative tax deduction 00:18:40.460 |
but you're still paying that money out of pocket. 00:18:43.300 |
And just to frame it again in terms of percentages, 00:18:52.980 |
what that's worth when you actually do the math, 00:18:55.420 |
that only decreases the mortgage rate to 7.3%, right? 00:19:15.200 |
yeah, I don't think it's as worth it as it was before, 00:19:34.660 |
However, how much benefit are you really gonna get? 00:19:45.700 |
are you really gonna get that big of a benefit 00:19:50.100 |
of making a bigger down payment now for that. 00:19:52.580 |
But I can see the benefit if you have a 7% or 8% 00:19:57.940 |
but what if you're gonna have it for two years 00:19:59.460 |
and you're gonna refinance at six in a couple years? 00:20:04.660 |
That's where I think you can kind of think through like, 00:20:08.860 |
So I think Ben, the way to actually solve the equation, 00:20:14.680 |
So yes, you can refinance, yes, you can move, 00:20:16.600 |
but what do you know what you're refinancing to? 00:20:20.240 |
What can I earn on my cash or short-term investments 00:20:29.200 |
And right now it favors paying down that mortgage 00:20:33.960 |
- And what's your, not only the investment hurdle, 00:20:40.000 |
means liquidity is drained and you're not gonna see it 00:20:42.940 |
versus you could say, I can earn 5% in T-bills right now, 00:20:46.100 |
but I get 8% in the mortgage if I'm paying it off, 00:20:47.900 |
but that 5% gives me more flexibility and more optionality. 00:20:52.640 |
so I think that's what you have to weigh as well. 00:20:56.220 |
- Precisely, and so for my 15-year career, Ben, 00:20:58.180 |
I usually have not been in favor of paying the mortgage off, 00:21:12.500 |
- Sorry, guys, I zoned out there for a second. 00:21:18.060 |
- I was gonna say, what's anti-Duncan doing these days? 00:21:25.720 |
- Probably, like heavily, heavily into fossil fuels. 00:21:29.560 |
- He's buying a stock that trades on real milk instead of-- 00:21:33.280 |
- Yeah, rolling coal in a dually or something, yeah. 00:21:40.260 |
- All right, up next we have a question from Wade. 00:21:44.820 |
and while 80% of my portfolio is in index funds, 00:21:47.820 |
I have a substantial amount tied up in Microsoft from RSUs. 00:21:52.280 |
You guys will have to remind me what that stands for. 00:22:03.940 |
and I'm concerned about having too much in one stock. 00:22:09.200 |
are substantial due to my low-cost basis of $60 a share. 00:22:14.560 |
I've been gradually selling and diversifying into ETFs, 00:22:20.520 |
I'm considering holding it long-term for heirs 00:22:23.440 |
with a stepped-up basis or donating it to charity, 00:22:29.400 |
congrats to Wade for retiring in his early 50s. 00:22:31.360 |
I guess that Microsoft stock paid off pretty well. 00:22:34.680 |
Microsoft actually hit new all-time highs recently. 00:22:40.720 |
and he's at $370 for Microsoft stocks, so not bad. 00:22:48.780 |
- One of the two biggest stocks that there is. 00:22:49.840 |
So it sounds like he made off pretty well here. 00:22:53.000 |
I guess, first of all, 15% doesn't sound egregious to me. 00:22:58.040 |
We've heard people come to us with 90% of their net worth, 00:23:14.280 |
So maybe you don't want to overexpose yourself. 00:23:23.120 |
like you mentioned, Wade's kind of built his portfolio 00:23:28.160 |
Wade's done a lot, I think, to kind of help with this. 00:23:30.720 |
But the reality has been, as far as index funds, 00:23:33.180 |
Microsoft makes up 7% of the S&P 500 index today 00:23:38.400 |
And so it's not just the stock that he owns directly, 00:23:41.480 |
but if you own an index passive weighted portfolio, 00:23:46.020 |
- Also, Duncan, sorry, RSU, Restricted Stock Unit. 00:23:57.120 |
- For the record, that was gonna be my guess. 00:24:06.180 |
'Cause ultimately, this is what victory looks like, Ben. 00:24:10.500 |
These are problems that I want to have, right? 00:24:14.340 |
I had 15% in this stock, and it crashed, and now it's 3%. 00:24:17.700 |
- Yeah, and there's that famous Reddit post of ExxonMobil. 00:24:22.600 |
that were the largest, Kodak, Eastman, et cetera. 00:24:25.740 |
So I think this would be my order of operations 00:24:34.080 |
and let that be the thing that you're building towards. 00:24:36.040 |
And if that's 10%, I think that's completely reasonable. 00:24:38.960 |
To your point, Ben, 15% doesn't sound that crazy to me. 00:24:50.100 |
maybe with a competent certified financial planner 00:24:53.200 |
or otherwise, I'm a company man, and whittle that down. 00:24:59.520 |
Wade kind of hit, for me, the number one option, 00:25:06.040 |
Ben, a donation to a donor advised fund in property, 00:25:08.880 |
you do not have to pay the capital gain on the transaction. 00:25:41.800 |
Double benefit, I wouldn't even call it a whammy, Ben. 00:25:58.400 |
So it's basically a way to turn 5,000 into 10 00:26:16.660 |
Once the transaction occurs through donor-advised fund, 00:26:18.700 |
you can sell that position capital gains tax-free 00:26:30.440 |
And so I think that the next thing for me would be, 00:26:36.180 |
So Wade mentions he's running an index-based portfolio. 00:26:41.060 |
How about 10% of your portfolio, let Duncan manage it. 00:26:55.620 |
and offset those gains with losses over time. 00:27:02.180 |
Wade mentioned he's thinking about retirement, 00:27:05.300 |
than maybe it was two years ago, three years ago. 00:27:11.180 |
but in January, realize a bunch of capital gains 00:27:13.620 |
and then seek opportunities with that capital 00:27:38.140 |
So if he wants it or needs to use it or whatever, 00:27:45.900 |
So if you have to pay those taxes, that's also paid. 00:27:50.820 |
You could sell some of them off to lock in the gains 00:27:58.620 |
Is there an easy way for people to be able to see 00:28:00.860 |
the overlap and like what their actual percentage 00:28:11.740 |
X-Ray Morningstar had a product a couple of years ago 00:28:13.980 |
that was free for subscribers. - Yeah, there's a few 00:28:16.620 |
- The other thing, and again, I'm a company man, 00:28:18.820 |
but there are companies that'll do tax-less harvesting 00:28:22.900 |
we have a partnership with O'Shaughnessy Asset Management 00:28:41.060 |
- I'm a company man, though. - All right, next question, 00:28:42.380 |
and we'll talk a little bit about this other option 00:28:46.900 |
- Last but not least, we have a question from Sam. 00:28:49.740 |
I'm 38 and have $175,000 in a brokerage account, 00:28:58.260 |
An advisor suggested an SMA that does tax-less harvesting 00:29:10.060 |
The fees are 10 to 15 times higher than low-cost ETFs, 00:29:14.100 |
but I'm tempted if it can help my long-term savings. 00:29:27.580 |
but that's a separately managed account, right? 00:29:31.380 |
What exactly does that mean, the cliff notes of that? 00:29:36.700 |
as opposed to buying an ETF for a mutual fund. 00:29:42.620 |
is people who have a large position with a gain, 00:30:17.740 |
I'm gonna have this company buy all 500 stocks for me 00:30:22.060 |
and they can also do some tax-loss harvesting 00:30:25.500 |
some of those stocks are gonna go down each year, 00:30:36.820 |
- Yeah, that's it, and that did directly bend your point. 00:30:39.300 |
We segued directly in this from Wade's question. 00:30:55.580 |
and it'll figure it out over the course of a year 00:30:57.700 |
if you give it enough time. - Right, you're essentially 00:31:00.620 |
with a tax-loss harvesting piece on top of it. 00:31:02.700 |
- Yep, so yeah, I think concentrated positions 00:31:18.180 |
can a strategy outperform is unanswerable, right? 00:31:22.980 |
a lot of strategies underperform a baseline index. 00:31:25.700 |
I think for us, Ben, kind of our philosophy is, 00:31:38.540 |
and so they might factor weight is a great example 00:31:41.340 |
to get a little bit of active passive exposure. 00:31:48.340 |
is you can effectively screen out portfolios. 00:31:56.300 |
So instead of shorting it or some other instrument, 00:32:08.780 |
The other thing is, what I wanna ask here for Sam 00:32:18.060 |
When does this type of strategy not make sense? 00:32:26.180 |
- Yeah, I think one big thing that comes to mind, Ben, 00:32:28.620 |
if most of your assets are in tax-qualified accounts, 00:32:35.980 |
But yeah, investing is more or less a problem 00:32:45.340 |
would simply be a lower-asset portfolio, right? 00:32:48.500 |
So if and when, until we have fractional shares available, 00:33:12.020 |
that Sam lays out, that I'm gonna pay a manager 00:33:16.260 |
And again, I think that typically happens, Ben, 00:33:28.380 |
- I would think so, especially if he's in a high-tech state 00:33:30.100 |
like our guy, John, in the first question, right? 00:33:38.740 |
Like, we are playing this game for our clients. 00:33:40.260 |
So we do think that there's a lot of value here. 00:33:41.900 |
- And I think this, the hard thing for a lot of people 00:33:45.620 |
this is really more of a financial planning tool 00:33:50.260 |
but I think you need someone helping you with it 00:33:53.740 |
Because it'd be hard to do something like this on your own 00:33:56.540 |
and know when to turn that dial up and turn it down, 00:34:00.940 |
even though it's really applied to investments. 00:34:03.380 |
- Just to give our guys on the team a big shout out, 00:34:05.540 |
Patrick Haley, Dylan Klonder, Alex Messer, Nick Gomes, 00:34:08.340 |
the folks that put this together for us on our company, 00:34:12.420 |
And what we learned over the last three, four years 00:34:14.820 |
of working with Canvas, looking at our Shaughnessy, 00:34:16.780 |
a lot of work has to go in upfront to get this right, 00:34:21.780 |
And so some advice is worth paying for, in my opinion. 00:34:25.540 |
but there's a lot of heavy lifting manual labor 00:34:27.380 |
that's done upfront to make sure that algorithm 00:34:30.020 |
- I'm not gonna say the company we work for again, 00:34:31.460 |
'cause Duncan will jump out of a New York City window, 00:34:40.620 |
you just made me think of something John was just telling, 00:34:47.220 |
He went somewhere in New York City that has coffee 00:35:07.660 |
- I mean, Robert Cialdini is gonna be running these things 00:35:10.420 |
and people are gonna be just handing their money over. 00:35:14.420 |
Like, that coffee tastes like ass, so I'm not doing it. 00:35:21.260 |
and put it down on the counter for him and stuff. 00:35:23.780 |
- If you don't drink coffee, you don't have to tip. 00:35:25.780 |
- Hey, those GPTs don't pay for themselves, you know. 00:35:35.180 |
Thanks to Duncan for sharing his portfolio once again. 00:35:38.180 |
Oatly's gonna have a Santa Claus rally, Duncan. 00:35:41.780 |
- Remember, email us, askthecompoundshow@gmail.com. 00:35:46.020 |
We had Wade in here listening to his own question today. 00:35:49.780 |
Subscribe, rate, review, all that kind of stuff.