"A STATISTICAL TIE".
By Nick Beaudrot
This is a banal point after four years of blogospheric poll watching, but Taegan Goddard writes "According to a new Pew Research poll, Sen. Barack Obama's national lead over Sen. John McCain has disappeared. The race is now a statistical tie, with Obama barely edging McCain, 46% to 43%."
No. No no no no no. Just, no. With a three-point lead, even in a poll that has a 5% "margin of error", there is a very, very strong probability that Barack Obama is ahead among voters who have an opinion. Kevin Drum wrote up the primer everyone should read. In addition, the Pew survey has a sample of 2,414 registered voters, a large sample that has a "margin of error" of ... 2.5 percentage points. That's smaller than the size of his lead!
Feeds: 


COMMENTS (23)
People have been trying to get the media to stop reporting polls this way for years, without result. They just won't listen.
Posted by: arbitrista | August 13, 2008 3:54 PM
Thanks for the link.
It would certainly be useful if reporting on polls would follow the lead of scientific papers and, instead of deciding upon a "margin of error", simply tell us what the probability is that the lead shown in the polling is meaningful. Or the p-value that the suggested lead is simply random chance.
I've yet to see a poll with McCain above 43%, and most have him lower. Obama has led McCain in every poll I've seen. At some point, the accumulation of polls should lead to a greater confidence in their collective message, namely that Obama is ahead.
Posted by: Whispers | August 13, 2008 4:16 PM
Have you ever taken a stat course?
The reason for the 'statistical tie' term is that Obama's lead is less than the margin of error. What this means is it shows Obama up by 3 points this time. If they took another sampling, it might show McCain up by 2...or it might show Obama up by one or down by one. Because of the possible errors, a slightly different result will be obtained each time the same population is sampled.
Posted by: El Viajero | August 13, 2008 4:18 PM
Have you ever learned to read, El Viajero?
Posted by: ML | August 13, 2008 4:23 PM
Have you, Viajero? First of all, if the margin of error is 2.5% and Obama is up by 3%, then his lead isn't less than the margin of error. But even if it were, the various possible outcomes from additional polls are not equally likely. With this lead it's certainly possible that there's a tie (just as there would be with any other lead), but it's much more likely that Obama is ahead -- just not 95% likely.
Posted by: KCinDC | August 13, 2008 4:27 PM
Not to rain on everyone's parade, and I certainly wish that polls were better reported (any lead shows a >50% probability the leader is actually ahead), but... a 3% lead is within a 2.5% Margin. Obama could be down 2.5%, McCain could be up 2.5%, both of those would be within the first standard deviation of probability. And in that case, McCain is ahead.
At the very least, the spread between the two isn't what's polled (even if it's what we call care about), so you can't simply apply the MOE to the spread.
Posted by: Shock Mouse | August 13, 2008 4:32 PM
Yikes, Viajero, you're way off. You didn't click the link to Kevin Drum, did you? MOE means there's a 95% chance that each number is within 2.5 percentage points, in this case, of the reported figure. It does NOT mean it's equally likely that McCain is actually ahead by 2.
There's an 85% chance that Obama's 3 point lead means he's actually ahead, according to Kevin's table. Go ahead, click it, learn something.
(Shock Mouse, I'd recommend a click as well)
Posted by: Chris O. | August 13, 2008 4:38 PM
The biggest problem is that the sampling error is only the error that's easy to calculate. The error resulting from the fact that those surveyed aren't a perfectly random sample of the actual voters and that their answers don't perfectly correspond to their votes may be larger than the margin of error, but it's ignored.
Posted by: KCinDC | August 13, 2008 4:44 PM
I'm just personally annoyed that there's this meme out there that somehow John McCain had gained ground or that Barack Obama is slipping.
If you check out the RCP or Pollster numbers, you'll see that Obama has maintained a constant lead that has actually widened a bit over the last week. (And the one recent McCain +1 poll was Gallup/USA Today poll with an extremely problematic likely voter screen; Obama was still ahead among RVs.)
Now, looking ahead, ask yourself, who is going to get a bigger, better convention bounce: the charismatic speaker who rises to the occasion with an ascendant, energetic party or the cringeworthy awkward speaker with the dispirited, discredited party, whose convention will feature a prime-time speech by one of the most unpopular presidents of the last hundred years?
I don't think it's time to get smug or complacent, but the mainstream media/RNC Obama concern-trolls, the Clintonista I-told-you-so-ers, the predicable Kossack chicken-littlers are full of shit. Obama's doing well and will likely soon being doing even better.
Posted by: Philly | August 13, 2008 4:48 PM
KC, completely agree with you there, flawed methodology is way more important to polls than is MOE. Averaging polls hopefully wipes away some of that but it's hard to say just how much. Unfortunately, that's basically admitting they're more for entertainment value than anything else. Still, I'd much rather have Obama be consistently ahead, as he has been.
Posted by: Chris O. | August 13, 2008 4:52 PM
Yikes, Viajero, you're way off. You didn't click the link to Kevin Drum, did you?
Yikes! when you're wrong, you're wrong. I did not follow the link and thought the margin of error was 5%.
Busted! My bad. Owning up to my error.
Posted by: El Viajero | August 13, 2008 5:27 PM
And of course the likelihood of multiple polls with multiple methodologies all showing a lead for Obama with McCain stuck in the low 40s is what ?
Posted by: akaison | August 13, 2008 6:08 PM
I am actually with the critics on this.
Yes, in theory, the margin of error just means there's still a 95 percent chance that the poll is close to being correct.
But in practice, what KC said is right. There are all sorts of errors made in polling, and the margin of error simply measures the likelihood that a truly random sample does not accurately reflect opinion.
The truth is we rely way too much on polls, there are plenty of examples of election results that were not consistent with the polls, and we should be careful about reading anything more than general trend information out of poll results.
Posted by: Dilan Esper | August 13, 2008 8:05 PM
Good on ya for being open to correction, El V.
Posted by: Chris O. | August 13, 2008 8:46 PM
Wow- Props to Viajero. I think that's the first time in internet history that someone's admitted to being mistaken about something on a comments thread. I was honestly taken aback by how refreshing it was.
Posted by: BitPicnic | August 13, 2008 9:28 PM
"The reason for the 'statistical tie' term is that Obama's lead is less than the margin of error. What this means is it shows Obama up by 3 points this time. If they took another sampling, it might show McCain up by 2...or it might show Obama up by one or down by one. Because of the possible errors, a slightly different result will be obtained each time the same population is sampled."
Except that Gallup runs a poll every day, and every day Obama is up between 3 and 6 points. You're correct for a _single_ sample, but we don't have single samples in the daily tracking polls. We actually have dozens of samples and the MOE vanishes when all of those samples reaffirm the same result.
Posted by: Martin | August 14, 2008 2:35 AM
it's funny how people keep repeating ideas- isn't the last post what I wrote above?
Posted by: akaison | August 14, 2008 8:53 AM
Let's all remmeber the 17 point lead Dukakis had about this time of the election year.
Things change. I wouldn't get too excited. Something in the air tells me it will be McCain. Telltale signs:
1)Unpopular war, troubled economy, etc., you would think the Democratic candidate would poll much higher at this time. He isn't.
2)Outspent 4:1, McCain still polls closely
3)The voters that will decide this election are not yet involved.
4)This issue with Russia could pull McCains numbers way up as voters take another look at the inexperience issue with Obama.
All I'm saying is it's not the shoe-in everone thought it would be and that gives me pause.
Posted by: El Viajero | August 14, 2008 10:33 AM
Then of course there is the larger problem which is that Presidents aren't elected by the national popular vote. Obama is in a very strong position by most tabulations of the electoral vote.
Posted by: Ron E. | August 14, 2008 10:35 AM
1988 isn't 2008 primarily because 1988 was the height of the GOP revolution, and 2008 is consigning the GOP to being a party of the South. No one thinks its a shoe in. Obama certainly isn't with his ground game (far superor to even Bush 2004) taking that risk. But to imply 2008 is similar to 1988 is missing the 20 years that have fundamentally reshaped the landscape. I would argue that even Dukakais would have a shoot in today's environment. Every Democrat would. That's how bad it is for the GOP.
Posted by: akaison | August 14, 2008 10:39 AM
The Dukakis 17 point lead was taken immediately after the successful 1988 Dem convention and before the GOP convention. The only thing the Dukakis 17 illustrates is the post-convention bounce.
It's apples and oranges. Time to put that silly meme to bed.
Posted by: danimal | August 14, 2008 1:17 PM
Also, these polls for sure are under representing young voters who do not have land lines (I'm assuming the polls are conducted by telephone) and are much more likely to support Obama.
Posted by: Nathan | August 14, 2008 6:03 PM
Young people run their mouths, but they don't seem to make it to the polling place like the old do.
Posted by: El Viajero | August 15, 2008 12:42 PM