When I saw the latest presidential poll in the New York Times, it literally ruined my day. The New York Times/Siena poll showed Trump leading Biden by five points nationally. Of course, that set off another round of hand-wringing about Biden’s age.

Happily a friend pointed me to a blogger I had never read: Jay Kuo, who blogs at The Status Kuo.

Today, Jay deconstructed the poll and made my day!

He wrote:

Leave it to the New York Times to stir up Democratic anxiety right before the State of the Union address, with a poll showing Trump beating Biden by five points nationally. A number of my friends sent the poll to me. Some of them are now filled with such gloom and doom that I wanted to lay out my thoughts on it plainly here for a wider audience.

It seems no matter how often I beat the drum about the polls being unreliable, premature and wrong, it doesn’t allay people’s fears enough. Talk of “ditching Biden” then ensues, which of course is not going to happen. We should just stop any discussion of it right now if we know what’s good for us.

So what about this poll? Isn’t the NYT / Siena a reliable indicator? They wouldn’t publish something that is basically false information, right?

Polls aren’t “false.” They report what people actually told the pollsters. But they can be misleading, and they are often faulty. Importantly, we shouldn’t trust any polls to be predictive of the final result when there are still more than 200 days to go till the election and a whole lot of unknowns. But let me focus in particular on this poll and what some experts on polling and methodology are saying about it. I hope you come away with the same conclusion I did: that this is some data, yes, but it’s not very reliable or useful except to make big headlines.

Women voters

One of the things I look for in a polling result is if any of the breakdowns, found in what’s called the “crosstabs,” raise red flags. One jumped out right away for me in this poll, and others saw it, too. As LSU professor and political historian Robert Mann noted,

I do not believe Biden is tied with women nationally 46-46… Biden got 57% of women in 2020. You’re telling me that, post-Dobbs, his support among that demo group will drop to 46? Not credible.

I agree. If you see a poll and half the women are voting for Trump, something went wrong in the polling sample. If women voted like they did in 2020, which we should assume would at least be the case especially since Dobbs, that’s an 11 point difference from this poll. Assuming the poll is half men, half women, that would put the two candidates about even.

Democrats

Here’s a thing I’m sure the Dean Phillips campaign would love to see become reality: The NYT/Siena poll has Phillips at 12 percent support among Democrats. 

Really? Because last time I checked, in the actual official contests that have been held, his actual vote haul averages 1.5 percent. As UCLA professor Matt Barreto noted,

There have been 3 DNC sanctioned primaries and Phillips vote:

South Carolina – 1.7%

Nevada – 0.0%

Michigan – 2.7%

So what people are *telling* the NYT/Sienna does not square with how they are VOTING.

It’s fair to ask which Democrats are bothering to respond to and answer these polls to completion. Perhaps it’s those who, on average, tend to be more disgruntled and want to voice their displeasure to a pollster? Are these Democrats also more likely to say they are unhappy with the current president? Just throwing it out there.

Young people

The news in this poll was partway decent for Biden when it came to young voters age 18-29. He leads Trump by 13 points among them, 54 to 41 percent—but that’s still around half the spread that other major polls have on this age group. But when it comes to messaging on the youth vote, the NYT prefers to emphasize the negatives, and its own data seems at odds with itself.

For example, as former pollster and turned sometime polling industry critic Adam Carlson notes, the NYT/Siena poll of swing states conducted back in late October showed Trump actually leading in this age group in AZ and GA, while being tied with Biden in MI. On this contrary, surprising and incorrect result, Nate Cohn of the Times did a whole serious write upabout what it could mean.

But when the new poll shows Biden actually leading nationally within this group by 14 points, Carlson observes, the NYT analysis completely ignored this. 

Perhaps that’s because it is hard to square that earlier result of Trump leading with this very different one of Trump trailing without calling one or both into serious question. Such huge swings in such a short amount of time don’t suggest that the electorate is moving quickly so much as that the polling might be way off.

[Please open the link and keep reading the rest of his analysis. It will make you happy.]