← Checking What You Hear, in Practice
Numbers and charts · 40 of 73
Look for the margin of error
Plain arithmetic
Do this
- Find the survey’s margin of error, and how many people answered.
- For a gap between two sides, double the margin.
- Is the lead bigger than that? If not, it’s too close to call.
- Small groups inside a survey, such as “students in Karnali”, have much bigger margins.
Why it works
A survey is a sample, and samples wobble. Pew Research explains that a simple random sample of 1,067 people gives about ±3 points on each share, and about ±6 on the gap between two. So a 5-point lead could really be anything from −1 to +11. A group of about 160 inside the survey gives about ±8 on each share. Other errors aren’t included in the margin, so it’s the least the doubt can be. Plain arithmetic.
Try it today
In any survey in the news, find the size and the margin. If it gives neither, note that too. Five minutes.
Where these facts come from
- 5 key things to know about the margin of error in election polls, Pew Research Center, 2016.
General information, not professional advice. No page can fit every situation. You use it at your own risk: see our terms. Spotted a mistake, or know something better? Tell us.
