Facts first. Center-right analysis. Primary-source receipts. Get The Morning Fix →

The Margin of Error Isn’t the Whole Error: How to Read a Political Poll

Fact / analysis labeled Primary sources linked 6 minute read

The 60-second summary

A political poll is an estimate of what a defined population said during a defined field period. It is not a vote count, a crystal ball or a probability that a candidate will win. Before believing the topline, check five things: who was surveyed, how the sample was recruited, when interviews occurred, the exact question, and how the pollster weighted or modeled the respondents.

The reported margin of error describes sampling uncertainty under specified assumptions. It does not capture every important threat, including people who do not respond, people the sampling method misses, flawed question wording, bad weighting or an incorrect likely-voter model. A polling average can reduce some random noise, but it cannot make a shared bias disappear.

Start with the population, not the horse race

“Voters support…” is incomplete unless the poll says which voters. Surveys may represent all adults, citizens, registered voters or likely voters. Those groups are not interchangeable. An issue poll of adults answers a different question from an election poll designed to estimate the electorate that will actually cast ballots.

Geography matters too. A national presidential poll estimates national opinion or the popular vote; it does not directly estimate the Electoral College. A state poll can be more relevant to an electoral outcome but often has fewer high-quality peers for comparison. For a primary, party rules and voter eligibility can make the target population narrower still.

Margin of error: useful, but narrower than it sounds

For a probability sample, the margin of sampling error estimates how much results would vary because the poll interviewed a sample rather than the entire target population. If a candidate has 48 percent support with a margin of error of plus or minus 3 percentage points, the customary interpretation places that candidate’s estimated support in a range from 45 to 51 percent at the stated confidence level.

But a candidate’s lead is a difference between two estimates. The Pew Research Center’s margin-of-error guide explains that the uncertainty around the difference can be roughly twice the reported margin for one candidate in a two-candidate example. A three-point lead in a poll with a stated plus-or-minus-three margin should not automatically be reported as a clear lead.

Subgroups have their own problem. A poll may contain 1,000 respondents overall but only 150 members of a demographic subgroup. The subgroup estimate is based on that smaller number and therefore is much less precise. The topline margin of error does not apply to every cross-tab.

Sampling and weighting: online is not a method verdict

A probability sample gives each unit in a defined frame a known, nonzero chance of selection. A nonprobability sample may recruit people from opt-in panels or other sources without known selection probabilities. Either can be conducted online, so “online poll” alone tells you little. The recruitment process and the statistical assumptions matter more than the screen on which a person answers.

Pollsters weight responses because the people who answer rarely mirror the target population perfectly. If college graduates respond at a higher rate than non-graduates, for example, weights can bring the sample closer to known population benchmarks. Weighting is necessary, not suspicious by itself. It also increases statistical variability when some respondents must count much more than others, which is why the design effect matters.

The American Association for Public Opinion Research’s disclosure standards call for pollsters to identify the sample source, recruitment and data-collection mode; report field dates, sample size and question wording; explain weighting; and distinguish probability from nonprobability methods. For probability surveys, AAPOR calls for a sampling-error estimate and disclosure of whether weighting or clustering was reflected. For nonprobability surveys, a precision measure should come with the model and assumptions that produced it.

Likely-voter models are forecasts inside the poll

A pre-election poll must do more than measure preference. It must estimate who will vote. Pollsters may use registration records, past voting, self-reported intention, interest in the election and knowledge of polling-place details, then set a cutoff or weight respondents by turnout probability.

No one knows the final electorate in advance. Pew’s election-polling methodology review calls turnout prediction a critical and difficult task because people cannot perfectly predict their behavior and the composition of voters changes. Two responsible pollsters can interview similar people and report different results because their likely-voter models make different defensible judgments.

Question wording and field dates can move the answer

Read the exact question and the questions immediately before it. “Do you support this bill?” may produce a different response after a list of benefits than after a list of costs. Check whether respondents heard candidate names, party labels, arguments from both sides or a one-sided description. A sponsor does not automatically invalidate a poll, but undisclosed sponsorship and missing wording are warning signs.

Field dates identify the period measured. A poll completed before a debate, court ruling or breaking story cannot reveal reaction to that event. A one-day shift between two different pollsters may be ordinary sampling and methodological variation, not a transformed electorate. Trends are more persuasive when several polls—or repeated surveys from the same pollster using a stable method—move in the same direction.

What a polling average fixes—and what it cannot

Averages reduce the attention paid to one noisy result and can reveal a broader trend. AAPOR’s polling-accuracy primer says averages are likely to carry somewhat less error than individual polls because some survey errors differ and partially cancel.

But an average inherits the polls it includes. If many surveys miss the same kind of voter, averaging them does not cure the shared miss. Aggregators also make choices about recency, sample type, pollster quality, partisan sponsorship and how much each poll counts. Some combine polls with economic or historical data to create a forecast. That forecast is a separate model, not the polling average itself.

The Daily Fix lens

Analysis: Healthy skepticism is a discipline, not a partisan exemption. Apply the same disclosure test to a poll that flatters your side and one that does not. The strongest use of polling is often descriptive: which issues motivate people, which groups differ, and whether a durable trend is forming. The weakest use is declaring a close election settled from one favorable topline.

The strongest limitation

A checklist cannot certify that a poll is right. Transparent pollsters can still miss a changing electorate, and opaque pollsters can occasionally land near the result by chance. AAPOR stresses that polls are estimates, not election forecasts, and that sampling error is only one source of error. Transparency lets readers evaluate the work; it is not a guarantee.

The one-minute poll audit

  • Population: Adults, citizens, registered voters or likely voters?
  • Place: National, state, district or primary electorate?
  • Field dates: What events happened before, during or after interviewing?
  • Recruitment: Probability frame, opt-in panel, mixed method—or an open website click poll?
  • Wording: Can you read the exact question, order and response choices?
  • Sample: What is the total size, and how small are the subgroups being highlighted?
  • Weighting and turnout: Which variables and likely-voter rules shaped the result?
  • Uncertainty: Does the stated margin cover only sampling error, and is the race close?
  • Context: Is this one outlier, a same-pollster trend, or movement across an average?
  • Sponsor: Who paid, who conducted it, and were all results released?

Sources and update note

Sources last checked August 15, 2026 at 5:36 PM ET. Polling methods and disclosure standards evolve. Recheck AAPOR’s current standards and the methodology statement for any live poll before publication or analysis.

Keep reading