Don’t Miss a Post. Subscribe now.

Models vs Humans: Models Can’t Think, but People Think About the Wrong Things

Let’s discuss economic models, election models, and the problems with each, also my recession model.

Data from the BLS, chart by Mish, through October.

My recession model is based on 15+ weeks of continued claims.

I discuss my recession model at the end of this post but first let’s continue with a model of sentiment vs the economy in my previous post.

The Paradox of Bad Sentiment

Please consider The Paradox Between the Macroeconomy and Household Sentiment by the Brookings Institute.

Here’s what happened. The Brookings Institute has a model that looks at GDP, CEO sentiment, the stock market, and even airplane traffic.

On the basis of those factors, Brookings concluded that Consumer Sentiment should be higher than what it is.

My hoot of the day is that it’s obvious why consumer sentiment is sour. My second hoot is that despite the obvious, Brookings could not figure it out.

Bias gets in the way.

The Brookings Institute Wonders Why Consumer Sentiment is So Bad, I Can Help

I gave 16 reasons, admittedly some overlapping, in my post The Brookings Institute Wonders Why Consumer Sentiment is So Bad, I Can Help

Brookings trained its model on GDP, not employment. Full Time Employment is -1,000,600 from a year ago! Excluding government, year-over-year employment is negative for the last 9 consecutive months.

Brookings did not ponder a 0.7 percent rise in the unemployment rate despite when it’s the direction that matters, not the level.

Brookings believed bogus stats that say crime is down.

Evictions are at record highs in many states and might be everywhere were it not for eviction moratoriums.

I added a couple new points this morning. Here is one of them: Tens of millions of people want to buy a home but can’t afford one and a different set of tens of millions of people are trapped in their homes but won’t because of mortgage rates.

I also added this: Even if you have a home, what about flood insurance, fire insurance, and car insurance.

And as I noted originally, but failed to list in my bullet point synopsis (now added), a Bank of America survey shows over 40 percent of the nation is living paycheck to paycheck.

If the Mises Institute sees this they will be laughing out loud.

The Brookings errors here are twofold. First models can’t think. Second, Brookings failed to go beyond pat answers given by Paul Krugman (the election and Republican bias), Greg Ip at the Wall Street Journal, and others.

In this case, models can’t think but neither could humans. And of course humans create models.

Brookings had a bad model of sentiment that just happened to correlate nicely with the economy until it didn’t.

Atlanta Fed GDPNow

Recently, I have been amazed at the accuracy of GDPNow. Kudos to Pat Higgins at the Atlanta Fed.

But when GDPNow was first published, most of us mocked it. Misses were widespread, in random directions.

Random errors are a good thing actually.

I am not sure if Higgins tweaked GDPNow much over time, but the last 8 quarters of GDPNow have been outstanding.

I have discussed this before, and mentioned it on October 30, 2024 in Real GDP Increased 2.8 Percent in the Advance 2024 Q3 Estimate

The BEA reported 2.8 percent GDP with Real Final Sales of 3.0 percent. Higgins’ forecast was 2.8 percent GDP with Real Final Sales of 2.9 percent. Wow.

Models don’t think. And that’s a good thing (as long as the model is a good one).

I reflect back on one of the GDPNow model forecasts at the beginning of the Covid Pandemic. The numbers were so horrific Higgins thought the model was wrong.

The above is from memory, so I might not be stating this accurately, but the model was fine. What appeared to be massive outliers were in fact accurate, as we soon found out.

I have no edge over the final forecast of GDPNow. Unless you have a better model than GDPNow, then you don’t either.

Humans Can Think, That’s Good and Bad

My explanation of what went wrong with Brookings is an example of human intelligence (or lack thereof) vs a model.

However, I too have my fair share of misses that good models don’t have.

For example, a huge number of us forecast a recession in 2023. I was very confident of this. So were others. I recall a Bloomberg model that had the odds close to 100 percent within a year.

What happened?

I have written about this before, but not a single model factored in the right things.

Amusingly, many economists still do not know what happened. But I do know why all these models (and my seat of the pants non-model) went wrong.

The 2023 Non-Recession

Q: What happened to stave off recession in 2022Q4-2023Q1?
A: A huge tax cut coupled with big jumps in minimum wages in 27 states!

The IRS adjusted tax brackets based off inflation and that put a sudden and huge amount of extra income into people’s pockets every month.

In addition, 27 states raised minimum wages starting January. Disposable personal income jumped a whopping 2 percentage points in a single month!

GDPNow did not predict that outcome. Nor did any humans that I am aware of.

However, the GDPNow model reacted to the data. I initially didn’t, nor did any of the recession models.

So, shame on us. An unthinking model beat the pants off those of us who thought about the wrong things or ignored the right things.

Ignoring the right things (not even seeing them), is what happened to Brookings.

Understanding Bias

All of us are biased in some ways. Models may or may not be. One attribute of a good model is that it is unbiased.

Unbiased does not imply accuracy. So a model that’s totally and randomly wild is not a good thing although lack of bias is.

People accuse Nate Silver of being biased. So have I. He wants Harris to win, and that comes through. He has even admitted as such.

But bias, if any, is in Nate Silver the person, not his model. Silver’s model is not biased in any predictable way. It reacts in mostly predictable ways to polling data.

This was a subject of a recent debate with a few friends of mine. One of them suggested Selzer, a prominent pollster, should throw away a sample that had Harris winning Iowa by three percentage points.

But good models don’t do that. Imagine GDPNow throwing away its reaction to disposable personal income when it jumped an amazing 2 percentage points in a single month.

Of course, disposable income can be verified while the odds of Harris winning Iowa can’t.

My friend still believes Selzer should not have published those results. You get into trouble throwing away results just because you don’t believe them.

I have biases too. I tend to be pessimistic on the economy. This is why I did not immediately change my mind on a recession on the jump in income killing a recession. Guilty as charged.

But I did want to know where and why I went wrong, so I went back later and created the Change in Personal Taxes chart above. Coupled with huge minimum wages hikes a pending recession that many of us predicted did not happen.

Amusingly, those who said no recession all along and brag about it were mostly lucky. Only those who said “no recession due to tax cuts” truly got it right.

I am unaware of anyone who got it right, because without that tax cut and extra income we were headed for recession.

So if you are bragging about your “no recession” call you may wish to reconsider how smart or lucky you were.

Recession Model

I never had a recession model until now. I had been typically persuaded by prominent people calling for a recession and my typical reaction was to go along.

But not this last time. When Danielle DiMartino Booth repeatedly forecast recession stating in October of 2023 based off a McKelvey recession indicator, I repeatedly stated that I thought she jumped the gun.

In May of 2024, I went along with the call based with on a clear and persistent change in the McKelvey indicator.

What is the McKelvey Recession Indicator?

Take the current value of the 3-month unemployment rate average, subtract the 12-month low, and if the difference is 0.30 percentage point or more, then a recession has started.

Edward McKelvey, a senior economist at Goldman Sachs, created the indicator. The problem with the indicator is that it has many false positives.

Claudi Sahm Modification

Claudi Samn, a former Fed economist, revised the rule, claiming it as her own, without credit to McKelvey, then set the indicator to 0.50.

Because that still had false positives, she started her series in 1960.

McKelvey Improvements

Improvements to the model by Pascal Michaillat and Emmanuel Saez, economists at the University of California in Santa Cruz, eliminate all false negatives and all false positive dating to 1951.

I discussed McKelvey many times including a calculation of recession odds on September 10, 2024 in The McKelvey Recession Indicator Triggered, But What Are the Odds?

On October 8, I commented McKelvey-PMES Recession Indicator Weakens Slightly but Signal Still Firm

Since then, the PMES signal weakened a bit further still, but it is still above my preferred 0.40 trigger vs 0.30 McKelvey.

My Own Recession Indicator

Based off the McKelvey and Michaillat formulas, I came up with my own recession indicator.

Please consider my October 11 post Continued Plus Long-Term Unemployment Claims Suggest Recession Right Now

I created a new recession indicator based on claims. Hurricanes have nothing to do with this.

The trigger weakened slightly in October but is still deep in the range where 100 percent of the time, dating to 1951, that the economy has been in recession under current conditions.

My trigger is based off the lead chart which is current. The slight weakening is due to a particularly bad month my model now views as stale despite the fact the key number made a new high as shown.

I do not know how to accurately assess odds because these models don’t decide recessions. Humans decide. Specifically, the NBER decides elections based on subjective reasoning, after all the revisions come in.

In one instance, the NBER decided a recession after it was already over. The huge NBER lag is why people have developed models.

Meanwhile, negative revisions are mostly the norm.

Rather than let my bias get in the way, I am now basing recession calls off McKelvey-PMES and my own trigger. They say the same thing. Recession is here or likely.

Perhaps this is a Brookings-style or disposable income type of miss, but I think not. The data goes back to 1951 with no false positives or misses.

Call it 50-50 if you like. This can go on for a while.

Anyway, that’s my model and it isn’t biased. If it suddenly switches to no recession, I will report so.

If you disagree with my recession model or the McKelvey-PMES model, both of which have a perfect track record on recessions dating to 1951, can I ask: What’s the track record of your model?

Subscribe to MishTalk Email Alerts.

Subscribers get an email alert of each post as they happen. Read the ones you like and you can unsubscribe at any time.

This post originated on MishTalk.Com

Thanks for Tuning In!

Mish

Comments to this post are now closed.

12 Comments
Newest
Oldest Most Voted
RonJ
RonJ
1 year ago

“Brookings had a bad model of sentiment that just happened to correlate nicely with the economy until it didn’t.”

Everything works until it doesn’t. The cyclical nature of things. The founders of Long Term Capital Management thought they had a perpetual money making machine, until they didn’t. “This time is different,” until it isn’t.

Stuki Moi
Stuki Moi
1 year ago
Reply to  RonJ

Which is why empirical models, ANY empirical models, have no more real relevance to economics; nor any social science; than raindances have to meteorology.

Rational optimizers WILL take into account every single one of them, along with every single action done as a result of their so-called “predictions”, into account, and game them until they are no better than pure random. Always and everywhere. The ONLY purpose they serve; for the modelmakers and those paying for them; is to justify the class of privileged nothings “managing the economy.” Which ALWAYS refers to nothing other than those guys transferring the fruits of other peoples labor to themselves. No exception.

That entire field of mindless babble is,100%, nothing more than pure charlatanism.

All defensible economics is deduction from indisputable first principles. And nothing more. That’s not a lot. For now, it’s little more than “Man, economy and State.” Read, then reread, then again, like The Koran is in a Taliban Madrassa.

There is NO room for ANY of the endless, unsupportable drivel being “published” by the various papermills claiming to be “economics” departments. None of which serve any other purpose than 1)facilitating the dilettante children of the Fed Welfare classes pretending to be something other than pointless dilettantes. And 2)excusing mismanagement of other people’s resources (which is simply a less obfuscated way of spelling “managing the economy”) by a privileged class of absolute nothing leeches who don’t, because they can’t, actually produce anything of value themselves.

Cas127
Cas127
1 year ago

This was an interesting and important post – but it was pretty long and lost me in places.

One general observation – if some/many input variables are flawed…the model’s output is pretty likely to be flawed,

I mention this because I’m seeing “unemployment rate” as a common input variable…but the “unemployment rate” metric (which one, btw?) has serious, well known definitional shortcomings.

That is a bright red warning light for model output.

Garbage in, garbage out.

That said, the commitment to continuous model improvement is to be commended.

dtj
dtj
1 year ago

“Specifically, the NBER decides elections….”

I think you meant the NSA/Deep State/CIA decides elections, not the NBER.

As to the topic on hand: Why not use a model of the economy that accounts for what actually causes recessions, rather than rely on ‘recession symptoms’ like unemployment claims?

On that note, credit demand is going to be a better predictor of recessions.

Spencer
Spencer
1 year ago

The payment of interest on reserve balances was the most disastrous policy ever introduced. And it was promoted by Paul Volcker. It is running the economy in reverse. It made housing unaffordable.

Lisa_Hooker
Lisa_Hooker
1 year ago
Reply to  Spencer

Yeah, but it’s the only thing that kept inflation from exploding after 2008.
Then they just printed and dropped money for Covid-19 to everyone.
The inflation cat is out of the bag so to speak.

Spencer
Spencer
1 year ago

What happened?”

The O/N RRP facility was drained. That increased the money supply.

Max Corder
Max Corder
1 year ago

That’s nice, Mish, but why do we need a recession indicator? It reminds me of WWII when the war planners for the invasion requested a weather forecast from the weather-guessers (as we called them when I was in the Air Force). The weather-guessers told them that they could not guarantee a reliable forecast. The planners said, “We know that, but we need one for our model anyway”. That planning was life and death. A few basis points in a forecast are not, except for those who make their living on whether or not they are “right”.

Why not just let the proof of a recession (or no recession) be in the pudding, out there in the markets where people make their millions and millions of decisions every day? I believe that the markets will sniff it out and give you the answer you need to manage your portfolio risk.

Last edited 1 year ago by Max Corder
MPO45v2
MPO45v2
1 year ago

The perfect case for Data! Data! Data! On the election front, the data shows women overwhelmingly have come out to vote and that was always expected so my bias tells me they would vote for Harris but we’ll know if that’s true soon enough.

As for recessions, I will regurgitate what I’ve said before, we are in a new demographic paradigm of 10k people retiring daily and insufficient labor to replace those people. These retirees get $140 billion/month in spending money from SS then goodies from medicare. Too much money being pumped into the economy from now on and this number will only grow.

I’m still waiting on robots, self driving cars, and all the miracle tech that will save us which ironically would lead to mass unemployment. Until then, the job market will remain stable until we hit a black swan (WWIII, new pandemic, etc).

An alternative to a black swan driven recession would be a sudden drain of liquidity and there’s a new barometer that seems fairly accurate for that now. The irony is that it’s bitcoin.

https://www.lynalden.com/bitcoin-a-global-liquidity-barometer/

I do expect a recession in Q2/Q3 of 2025 as a result of a black swan or liquidity drain.

Eighthman
Eighthman
1 year ago

I ran across some You Tube videos featuring Eric Weinstein in which he asserts that CPI and employment stats are bogus and that no one will listen or change. It’s too deep for me but interesting

great post !

Not Artificially Intelligent
Not Artificially Intelligent
1 year ago

Great post!

Perhaps another thing that improved for many people in 2023 (helping to stave off the recession) was disposable income boost from the refinancing wave of 2021-2022 when rates were down?

And don’t forget the massive ongoing fiscal stimulus… $4,700,000,000,000 in national debt added over past 2 years!

Decorate Your Walls with Mish Fine Art Images

Click each image to view details or purchase in the store.

Stay Informed

Subscribe to MishTalk

You will receive all messages from this feed and they will be delivered by email.