(Roughly) Daily

In the last couple of decades, opinion polling in the U.S. has exploded; the number of national pollsters has more than doubled. Over the same period, American lifestyles have changed in ways that have challenged pollsters– and led them to innovate in a quest for accuracy. Indeed, after the embarrassment of the election of 2016, 61% of national pollsters have changed their methods…

The pollsters at The Pew Research Center— arguably the best of bunch– have polled the pollsters…

The 2016 and 2020 presidential elections left many Americans wondering whether polling was broken and what, if anything, pollsters might do about it. A new Pew Research Center study finds that most national pollsters have changed their approach since 2016, and in some cases dramatically. Most (61%) of the pollsters who conducted and publicly released national surveys in both 2016 and 2022 used methods in 2022 that differed from what they used in 2016. The study also finds the use of multiple methods increasing. Last year 17% of national pollsters used at least three different methods to sample or interview people (sometimes in the same survey), up from 2% in 2016.

This study captures what changes were made and approximately when. While it does not capture why the changes were made, public commentary by pollsters suggests a mix of factors – with some adjusting their methods in response to the profession’s recent election-related errors and others reacting to separate industry trends. The cost and feasibility of various methods are likely to have influenced decisions.

This study represents a new effort to measure the nature and degree of change in how national public polls are conducted. Rather than leaning on anecdotal accounts, the study tracked the methods used by 78 organizations that sponsor national polls and publicly release the results. The organizations analyzed represent or collaborated with nearly all the country’s best-known national pollsters. In this study, “national poll” refers to a survey reporting on the views of U.S. adults, registered voters or likely voters. It is not restricted to election vote choice (or “horserace”) polling, as the public opinion field is much broader. The analysis stretches back to 2000, making it possible to distinguish between trends emerging before 2016 (e.g., migration to online methods) and those emerging more recently (e.g., reaching respondents by text message)…

Fascinating– and important: “How Public Polling Has Changed in the 21st Century,” from @pewresearch (via friend PH).

* Neil Postman, Amusing Ourselves to Death

###

As we consider our answers, we might recall that it was on this date in 2016 that Pew Research Center published the results of a poll on voter satisfaction with U.S. Presidential candidates:

Voter satisfaction with the choice of presidential candidates, already at a two-decade low, has declined even further. A new survey finds that just a third of registered voters say they are very or fairly satisfied with the choices, while 63% say they are not too or not at all satisfied. That represents a 7-percentage-point drop since June in the share of voters expressing satisfaction with their candidate choices…

Already-low voter satisfaction with choice of candidates falls even further