Can we trust the 2020 US Election polls?

Can we trust the 2020 US Election polls?

Anders Nysteen
Senior Quantitative Analyst, Saxo Bank

A look at how pollsters have adjusted their methods for the 2020 election cycle.

The election result in 2016 seemed to show a catastrophic error in the US pre-election polls, triggering a great deal of forensic work on what went wrong. Investigations revealed that the national polls were actually quite accurate and correctly saw that Hillary Clinton would win the popular vote, with only a small deviation from the poll estimate. Specific state-level polls for Pennsylvania, Michigan and Wisconsin, however, were another matter. The polling averages for these three states showed Clinton with a solid lead. But they ended up going to Donald Trump by a razor-thin margin, making the difference in the election outcome.

In nearly all US Presidential elections, the winner of the national popular vote also wins the Electoral College and thus the presidency. This also appeared to be the case in the days leading up to Election Day 2016, where forecasts gave Clinton around a 90% probability of winning the presidency, with a range of 71% to 99%.

Below, we review some of the findings from analysts such as the American Association for Public Opinion Research (AAPOR) and Marist College’s Institute for Public Opinion regarding why key state polls underestimated the support for Trump.

1. Undecided voters played a significant role 
In key states, more than half of undecided votes went for Trump. In Pennsylvania, Michigan, Florida, and Wisconsin, 11-15% of voters made their decision in the final week. On a national basis, 20% of voters in 2016 had not decided three months prior to the election. This time around, things look a bit different. Three months before the 2020 election, only 10% of those polled said they were undecided (or did not care), but analysts still see this as sizeable enough to affect the election.

Undecided voters tend to be heavily affected by events, and studies have shown that negative campaigns and campaign ads may have a bigger effect on undecided voters than positive campaigning. Will Biden’s heavy negative ad spending and Trump’s recent cash woes tilt the balance for Biden, or can Trump make a sprint to the finish on a bad debate performance from Biden? Past election cycles show that significant changes can occur in the final weeks of the campaign, though the polls have been far more stable in this election cycle.

2. Adjustment for education level 
This was implemented in many national polls, but fewer state ones. Voters with higher education levels are more likely to complete surveys compared to less-educated peers. In a survey from 2017 looking at typical national polls, 45% of the respondents had a bachelor’s degree or higher, although this number was only around 30% in the general population.

During the two Obama elections, whites with lower educational achievement began tilting more Republican. Furthermore, less-educated voters tend to follow news on a less consistent basis and may thus be more open for persuasion – especially via targeted social media, a possibly decisive factor in battleground states in 2016. Key-states polls in the 2016 election may likely have had an overrepresentation of higher education levels, which were associated with the overestimated support for Clinton.

3. Geography
Geography plays a role when drawing representative samples for polls, as certain voter classifications may vote very differently depending on whether they live in urban, suburban or rural areas. Following the previous point, an uneducated white man living in the countryside may have a very different political opinion relative to an uneducated white man living in living in a large city or suburb in the same state.

4. A change in the voter turnout for key demographics 
This was another key factor in the 2016 election relative to the patterns in 2012. There was an increased participation among Republicans and rural voters in some key states, while the turnover decreased for some of the core Democratic voters – especially African Americans. The fact that Clinton had a significant lead in the polls may have kept some of the Democratic voters in their couch, feeling that their vote would not matter anyway. 

5. Shy Trump voters 
Trump voters that did not want to reveal themselves in the pre-election polls may have outnumbered the late-revealing Clinton voters in 2016, although no clear effect has been definitively proven. A recent study by CloudResearch shows that for the 2020 election, Trump voters are half as likely to reveal their true opinion about their preferred presidential candidate compared to Biden supporters.

Adjusting the 2020 polls
Polling organisations conduct surveys in different ways and through different media, and may thus be biased toward certain voter segments. As an example, 10% of American adults do not use the internet – an internet-based survey will underrepresent this group, which stereotypes might describe as a 65+ person with no higher education and low income, living in rural areas. The perfectly unbiased survey will forever remain unachievable, but being aware of these biases can help pollsters adjust for overrepresentations.

Over time, especially due to the internet, the barriers for conducting a poll have been drastically lowered, and the polling landscape is easily polluted by low-quality polls. In many polls, the errors tend to repeat in similar states, introducing a systematic miss, and the correlation between the poll results could easily be underestimated.

The typical polling margin is ±3% in state polls that can only ask a small subset of the whole population. Recent studies have shown that, when accounting for other possible errors such as the correlation between the state poll errors, the real-world margin of error should be twice as big. In practice, this means that some of the 2016 state polls would not have been able to call a winner within the uncertainty limits of the poll.

The larger polling organisations seem to be better prepared for the 2020 election, and are trying to learn from the pitfalls of their 2016 misses. Many of the errors above may be addressed by conducting thorough polling. One downside risk to this, however, is that it could result in polls which try to ‘overfit’ the 2016 scenario and may miss new developments specific to 2020. One new challenge is the Covid-19 pandemic, which may affect particular categories of voters more than others and may even lower overall turnout.

So, when analyzing 2020 election polls, one should be aware of i) how the survey group was selected, ii) if the survey is asking for other parameters such as education and geography, and iii) if the polls also report the uncertainty in their predictions. This seems to be a minimum requirement for conducting a reliable 2020 election poll, and if these things are not specified, one should be extra careful about drawing important conclusions.

The average error in national polls (first figure) has been in a downward trend and was relatively low for the 2016 election. The average error in state-level polls (second figure) was, however, higher in 2016 than in the past four presidential elections. Figures recreated from AAPOR.
Disclaimer

Saxo Capital Markets (Australia) Limited prepares and distributes information/research produced within the Saxo Bank Group for informational purposes only. In addition to the disclaimer below, if any general advice is provided, such advice does not take into account your individual objectives, financial situation or needs. You should consider the appropriateness of trading any financial instrument as trading can result in losses that exceed your initial investment. Please refer to our Analysis Disclaimer, and our Financial Services Guide and Product Disclosure Statement. All legal documentation and disclaimers can be found at https://www.home.saxo/en-au/legal/.

The Saxo Bank Group entities each provide execution-only service. Access and use of Saxo News & Research and any Saxo Bank Group website are subject to (i) the Terms of Use; (ii) the full Disclaimer; and (iii) the Risk Warning in addition (where relevant) to the terms governing the use of the website of a member of the Saxo Bank Group.

Saxo News & Research is provided for informational purposes, does not contain (and should not be construed as containing) financial, investment, tax or trading advice or advice of any sort offered, recommended or endorsed by Saxo Bank Group and should not be construed as a record of our trading prices, or as an offer, incentive or solicitation for the subscription, sale or purchase in any financial instrument. No representation or warranty is given as to the accuracy or completeness of this information. All trading or investments you make must be pursuant to your own unprompted and informed self-directed decision. No Saxo Bank Group entity shall be liable for any losses that you may sustain as a result of any investment decision made in reliance on information on Saxo News & Research.

To the extent that any content is construed as investment research, such content was not intended to and has not been prepared in accordance with legal requirements designed to promote the independence of investment research and as such, would be considered as a marketing communication.

None of the information contained here constitutes an offer to purchase or sell a financial instrument, or to make any investments.Saxo Capital Markets does not take into account your personal investment objectives or financial situation and makes no representation and assumes no liability as to the accuracy or completeness of the information nor for any loss arising from any investment made in reliance of this presentation. Any opinions made are subject to change and may be personal to the author. These may not necessarily reflect the opinion of Saxo Capital Markets or its affiliates.

Please read our disclaimers:
- Full Disclaimer (https://www.home.saxo/en-au/legal/disclaimer/saxo-disclaimer)
- Analysis Disclaimer (https://www.home.saxo/en-au/legal/analysis-disclaimer/saxo-analysis-disclaimer)
- Notification on Non-Independent Investment Research (https://www.home.saxo/legal/niird/notification)

Saxo Capital Markets (Australia) Limited
Suite 1, Level 14, 9 Castlereagh St
Sydney NSW 2000
Australia

Contact Saxo

Select region

Australia
Australia

The Saxo trading platform has received numerous awards and recognition. For details of these awards and information on awards visit www.home.saxo/en-au/about-us/awards

Saxo Capital Markets (Australia) Limited ABN 32 110 128 286 AFSL 280372 (‘Saxo’ or ‘Saxo Capital Markets’) is a wholly owned subsidiary of Saxo Bank A/S, headquartered in Denmark. Please refer to our General Business Terms, Financial Services Guide, Product Disclosure Statement and Target Market Determination to consider whether acquiring or continuing to hold financial products is suitable for you, prior to opening an account and investing in a financial product.

Trading in financial instruments carries various risks, and is not suitable for all investors. Please seek expert advice, and always ensure that you fully understand these risks before trading. Saxo Capital Markets does not provide ‘personal’ financial product advice, any information available on this website is ‘general’ in nature and for informational purposes only. Saxo Capital Markets does not take into account an individual’s needs, objectives or financial situation. The Target Market Determination should assist you in determining whether any of the products or services we offer are likely to be consistent with your objectives, financial situation and needs.

Apple, iPad and iPhone are trademarks of Apple Inc., registered in the US and other countries. AppStore is a service mark of Apple Inc.

The information or the products and services referred to on this website may be accessed worldwide, however is only intended for distribution to and use by recipients located in countries where such use does not constitute a violation of applicable legislation or regulations. Products and Services offered on this website is not intended for residents of the United States and Japan.

Please click here to view our full disclaimer.