by Mish

Today, Nate Silver confessed that he screwed up.

Well, sort of.

Nate Silver says How I Acted Like A Pundit And Screwed Up On Donald Trump.

The title is perfect. Perhaps Silver should have stopped there. He goes on to say …

I also wonder if there’s been too much #datajournalist self-flagellation. Trump is one of the most astonishing stories in American political history. If you really expected the Republican front-runner to be bragging about the size of his anatomy in a debate, or to be spending his first week as the presumptive nominee feuding with the Republican speaker of the House and embroiled in a controversy over a tweet about a taco salad, then more power to you.
The FiveThirtyEight “polls-only” model has correctly predicted the winner in 52 of 57 (91 percent) primaries and caucuses so far in 2016, and our related “polls-plus” model has gone 51-for-57 (89 percent). Furthermore, the forecasts have been well-calibrated, meaning that upsets have occurred about as often as they’re supposed to but not more often.

Please stop the self-congratulations. Nate, please tell us how the hell you put Indiana in the “win” column.

Silver was wrong on Indiana every step up the way with poll after poll after poll after poll projecting Cruz would win.

On April 30, “Silver’s Secret Sauce” projected Cruz had a 65% chance of winning Indiana. On May 1, I reported Silver Flushes Secret Sauce Down Toilet, Now Projects Trump has 69% Chance.

Silver puts that monstrous last-minute flip-flop in the win column. I call that pathetic.


There’s a lot more to the story, so I’m going to proceed in five sections:

  1. Our early forecasts of Trump’s nomination chances weren’t based on a statistical model, which may have been most of the problem.
  2. Trump’s nomination is just one event, and that makes it hard to judge the accuracy of a probabilistic forecast.
  3. The historical evidence clearly suggested that Trump was an underdog, but the sample size probably wasn’t large enough to assign him quite so low a probability of winning.
  4. Trump’s nomination is potentially a point in favor of “polls-only” as opposed to “fundamentals” models.
  5. There’s a danger in hindsight bias, and in overcorrecting after an unexpected event such as Trump’s nomination.

Silver’s admission on point 1 is quote revealing. In effect he admitted blatant bias, overruling his own model.

In points 2, 3, and 5 Silver attempted to sweep his bias under the rug.


Point 4 is also an interesting admission. That is something I hammered Silver on for months on end.

Silver’s “Polls Plus” forecasts have been little more than biased bullsh*t.

The entire rest of his lengthy post was noting more than an attempt to sweep the mess under the rug.

Here’s the question I ask: Did Silver learn a damn thing?

Here’s a few things I know.

  1. Changing social attitudes matter.
  2. It was clear in December that voters did not care what silly things Trump said.
  3. Silver favored historical precedents over massive attitude changes. That was a big mistake, and one I warned Silver on in December.

Flashback December 10: Attitudes, Attitudes: Dear Nate Silver, Regarding Donald Trump, You Are Missing Something Big!

In January I wrote about Nate Silver’s Continual Underestimation of Donald Trump’s Chances.

Reflections on Being Wrong

I am not purposely attempting to brag. I may have been wrong.

I have been wrong on many things, most notably the prolonged effect QE had on the market.

I was totally wrong.

I now think Trump will win the election. I may be wrong about that. And I may change my mind thirty days from now.

But I won’t change my mind one day before the election with a proclamation that I got it right.

Mike “Mish” Shedlock

Diving Into Nate Silver’s Secret Sauce

From the beginning of this election season I have been highly skeptical of the odds Nate Silver has placed on various candidates winning various primaries.

Piss Poor Analysis by Financial Times, Nate Silver, Others, on Trump’s Chances of Winning

The global media in general, Nate Silver specifically, and the Financial Times specifically do not want Donald Trump to win the Republican nomination.

Nassim Taleb Blasts Nate Silver About Election Odds in Series of Tweets

When it comes to discussion of probabilities, Nassim Taleb’s opinion carries a lot of weight. Taleb is author of the New York Times bestseller The Black Swan: Impact of the Highly Improbable.

Tony Blair’s Disingenuous, Self-Serving Analysis of Iraq

When I mentioned names of those who played a role in the current mess in Iraq (see Assessing the Blame for Iraq: Bush, Obama, McCain, Others; Iraq Sunken Costs), I left out one key name, former UK prime minister Tony Blair.

Biggest Upset in History: Wrong, Wrong, Wrong, Right; Best Speech of Trump’s Life

The media was wrong, the polls were wrong, and Nate Silver was wildly wrong. And as long as we are counting, I was wrong.

Mexican Congress Debates the Monetization of the ‘Libertad’ Silver Ounce

Guillermo Barba shares his post on a debate in the Mexican Congress to monetize the ‘Libertad’ silver ounce coin. The original article is in Spanish.

Nate Silver on the Iowa Shit Show

We have learned a half dozen things from the Iowa Caucus. Let's go over them point by point.

Yellen’s Self-Serving Assessment: Fed is “Doing Pretty Well”

Now that the bubbles have been blown (but still remain invisible to the Fed), Fed Chair Janet Yellen Yellen conveniently pats herself and the Fed on the back for a job piss-poorly done.