Skip to content

← Checking What You Hear, in Practice

Numbers and charts · 40 of 73

Look for the margin of error

Plain arithmetic

Do this

  1. Find the survey’s margin of error, and how many people answered.
  2. For a gap between two sides, double the margin.
  3. Is the lead bigger than that? If not, it’s too close to call.
  4. Small groups inside a survey, such as “students in Karnali”, have much bigger margins.

Why it works

A survey is a sample, and samples wobble. Pew Research explains that a simple random sample of 1,067 people gives about ±3 points on each share, and about ±6 on the gap between two. So a 5-point lead could really be anything from −1 to +11. A group of about 160 inside the survey gives about ±8 on each share. Other errors aren’t included in the margin, so it’s the least the doubt can be. Plain arithmetic.

Try it today

In any survey in the news, find the size and the margin. If it gives neither, note that too. Five minutes.

Where these facts come from

General information, not professional advice. No page can fit every situation. You use it at your own risk: see our terms. Spotted a mistake, or know something better? Tell us.

← All 73 small things