In the course of surfing the Web last week, you may have come across some polling data showing that large numbers of Republicans believe some pretty scary things about the president. The figures, provided by Harris Interactive, seem to have been first reported by Daily Beast contributor John Avlon in an item posted at midnight Tuesday. The story, titled “Scary New GOP Poll,” cited details including:

45 percent of Republicans (25 percent overall) agree with the Birthers in their belief that Obama was “not born in the United States and so is not eligible to be president”

38 percent of Republicans (20 percent overall) say that Obama is “doing many of the things that Hitler did”

Scariest of all, 24 percent of Republicans (14 percent overall) say that Obama “may be the Antichrist.”

Ok, maybe that last line is not meant to be taken seriously, but still, pretty crazy, right? And Avlon wrote that “the full results of the poll… are even more frightening.” But those results wouldn’t be available until Wednesday, meaning there was no way for readers to see them—and, more importantly, no way for skeptics to examine the poll’s methodology—as the early numbers filtered through the media.

But soon enough, the results did come out, and they were promptly and persuasively skewered by, among others, Gary Langer, the polling director for ABC News. Langer’s post clearly summarizes various shortcomings of the poll, from its approach to sampling to the way it persistently pushed respondents toward more extreme positions through “a highly manipulative approach to questionnaire design.” The obvious response is that, whatever the design, 14 percent of respondents really did say that Obama “may be the Antichrist.” But as Langer writes near his conclusion, good polling involves more than simply asking a question:

Unless carefully crafted, with balance and an approach that encourages due consideration and probes for meaning, simply asking the question can turn into little more than the old reporter’s trick of piping quotes. It’s a shopworn use of true/false and agree/disagree questions, one long overdue for retirement.

Langer’s post doubles as a helpful primer on polling methodology, but even for those not interested in the arcane, there were plenty of red flags here. As Avlon wrote in his item, the poll was “inspired in part by my new book Wingnuts.” (The full title is Wingnuts: How the Lunatic Fringe is Hijacking America.) While Avlon apparently did not pay for the poll, the opening of the Harris press release cited his book by name, and stipulated that the purpose of the poll was “to measure how many people are involved” with right-wing extremism.

It sounds not so different from a similar poll commissioned by Daily Kos founder Markos Moulitsas earlier this year, which, he wrote on his blog, was meant to provide support for “certain claims about Republicans” he was making in his book, American Taliban. (That poll, too, came under scrutiny from experts in the field: see here, here, and here.) Most inquiries begin with propositions to test, of course, but in these cases there seem to be clear incentives for all involved are to generate as many scary-sounding responses as possible. (Harris has responded to criticisms of its poll’s methodology, and the motivations behind it, in a Q&A at its site.)

What are the consequences of this? Well, for one thing it seems likely to, if anything, entrench the environment of “fear and hate” these writers are decrying: even as Avlon worries over “hyper-partisanship,” he’s feeding his readers tenuous numbers that give them permission to believe their worst fears about conservatives.

  • 1
  • 2