Skip to content

← Thinking Clearly

Health claims

Chapter 30 · The phone

In this chapter 4 sections
  1. The video, line by line
  2. A remedy that passes
  3. Three dots
  4. What the questions are for

In late June 2020, with the coronavirus spreading and no vaccine anywhere, some of the most senior politicians in Nepal came to a meeting of their party wearing a small card on a cord around the neck, like an identity badge. Some wore it in parliament too. It was called a virus removing card. As one lawmaker explained it, the sellers said it worked like a mosquito coil: it kept the virus away from the air around the person wearing it. A trading company had brought ten thousand of the cards in from China.

Cards like it were on sale around the world, under names such as Virus Shut Out and Air Doctor, for about 18 to 25 dollars online. Senior officials in South Sudan had been photographed wearing them. The working part was said to be chlorine dioxide, a real disinfectant, used to treat drinking water and to sterilize medical equipment. Japan’s consumer affairs agency had warned in May that the card didn’t protect against COVID-19, and so had the Philippines’ medicines regulator, while America’s environment agency had turned shipments of one brand back at its ports in March. Fact-checkers counted it as banned in several countries. One specialist in infections in London told fact-checkers it was bogus and should be banned everywhere.

In Kathmandu the answer came within days. At its regular briefing, Nepal’s Ministry of Health and Population said that the card didn’t keep the virus away, that nobody had been given permission to sell this one, and that the chemical in it could do serious harm to the heart, lungs and liver. At the party’s next meeting, only one leader still had a card on. One of the lawmakers explained to Kantipur why they had worn them, and why some had bought them for their families too. If it stops the virus spreading, they had thought, why not wear it? Then they learned that it hadn’t been proven anywhere, and that it could harm their health, so they stopped.

“Why not?” is the question that health claims live on. A card is cheap, a tea is cheap, and if it works, how wonderful. But a doctor, Sher Bahadur Pun, asked the question on the other side, publicly, the same week: would the people wearing those cards now feel safe enough to forget about keeping their distance, wearing masks and washing their hands, the things that did help? A remedy that does nothing is rarely just nothing. It can cost money, it can cost the real treatment, and it can cost the care a person would otherwise have taken.

Health claims are where everything in this book comes together, because they ask the most of you: your money, your trust, sometimes your body, and the hope of someone you love. Taking one apart comes down to eight questions, asked in order. What exactly is being claimed? Who gains if you believe it? What do its numbers mean? Who isn’t in the picture? Would it have happened anyway? Was there a fair test? What do the people who study it say? And could anything at all prove it wrong?

The video, line by line

The forwarded video from the start of this book is a health claim too. (It’s made up, and so is the tea.) It says that हिमाली बुटी चिया, Himalayan herb tea, from a plant that grows only high in the mountains, cured a grandmother’s diabetes in 30 days. It says the doctors know and are hiding it. It says 95% of the people who tried it got better. And it’s half price, but only today.

Start with what it says. “Cured” sounds exact, and isn’t. Diabetes is a long-lasting disease in which the body can’t keep the sugar in the blood under control. Cured how? Her blood sugar was normal on one test? She stopped her tablets? It stayed normal for a year? And the 95% “got better”, which could mean anything from a number on a lab report to a better night’s sleep. The cheapest check in this book is to ask what a sentence really says before deciding whether to believe it. A claim that could be wrong would sound like this: her blood sugar, measured the same way, stayed normal for a year without her tablets. The video never takes a risk like that.

Next, who gains. Whoever is selling the tea, plainly, and they set the deadline. “Half price, only today” is there to hurry you past the questions, and it has nothing to do with whether the tea works. The plant “that grows only high in the mountains” does two jobs at once. It borrows the good feeling that surrounds anything natural and old, and it means nobody can go and check the plant for themselves. The United States’ medicines regulator, the FDA, lists exactly these marks of health fraud: talk of a miracle, a secret or an ancient remedy, “natural” used as a selling point, a quick cure, and grateful stories that can’t be checked. A seller can still be telling the truth. But what they stand to gain says how much their word can carry on its own, which here is very little.

Then the number. Ninety-five percent of what? Out of how many: twenty people, or twenty thousand? Who counted, and who was asked? If the seller asked the customers who wrote back, the 95% describes the people pleased enough to write. And better than whom? Nearly everyone with a cold gets better on almost anything, because colds end.

That points to who is missing. The grandmother is one person, picked by the seller from everyone who ever bought the tea. The people who drank it and stayed the same don’t make videos, and anyone who stopped their medicine for it and got worse has the least reason of all to tell the world. A wall full of grateful stories looks the same whether the tea works or not, so ask who isn’t in the picture.

Then, would she have got better anyway? Suppose every word of her story is true. She probably started the tea in a worried week, after a bad reading, and the next reading was likely to be better whatever she drank. A new remedy often comes with other changes, a different diet, more walking, her tablets taken more carefully, and changes like those can sometimes bring blood sugar back to normal by themselves. A true story about one life has nothing to compare it with, which is why getting better anyway hides inside so many sincere ones.

So was there a fair test? The video doesn’t mention one. A fair test is slow and costs money, but it is well within reach of anyone selling tea by the thousand boxes. Take a few hundred people with diabetes, let a coin decide who gets the tea and who gets a look-alike tea with nothing in it, keep everyone from knowing which they had, and have a laboratory that doesn’t know either measure their blood sugar after three months. That is a fair test, and a seller who believed in the tea would have every reason to run one and print the result on the box. The video offers a story instead.

What do the people who study diabetes say? Health services treat it as long-lasting, kept under control with medicines and with eating well, moving more and losing weight. Britain’s NHS says those changes can sometimes bring blood sugar back to a normal level, which doctors call remission, and it says too: don’t stop taking diabetes medicine unless your doctor tells you to. A tea that cured it in a month would, as the FDA puts it about any real cure, be widely reported and regularly prescribed by health professionals. Where the people who know a field agree with one another, a forwarded video is a long way behind.

Last comes the line built to survive all the others: the doctors know, and they’re hiding it. Once that is believed, every doctor who says the tea doesn’t work becomes more evidence of the plot, and so does every study that finds nothing. It is an idea that can’t lose, so it’s worth asking the seller, and anyone who forwards it, what would change their mind. None of this means medicine is never wrong. Journals have preferred good news, companies pay for studies, and science goes wrong in ways it has had to learn to catch. Doctors were once sure that stomach ulcers came from stress and spicy food. But they were shown wrong the ordinary way, by trials that anyone could read, and the cure they had missed reached clinics everywhere within about a dozen years, through journals, not a forwarded clip.

Not one of the eight questions proves that the tea does nothing. Together they show that the video gives no reason to think it does anything, and several reasons for caution, the most serious being that someone might stop a real medicine for it.

A remedy that passes

Now try a claim that sounds every bit as much like a forwarded post. A pinch of salt and a little sugar, stirred into clean water, saves children from dying of diarrhea.

It’s true, and in Nepal it has a name: जीवनजल (Jeevan Jal), “water of life”, the best-known brand of oral rehydration salts in the country. Put it through the same questions and watch how differently it answers.

Is it specific? Very. The World Health Organization (WHO) describes it as a mixture of clean water, salt and sugar that is taken in by the small intestine and replaces the water and salts lost in diarrhea. It doesn’t claim to stop the diarrhea. Most bouts end by themselves, and the danger in the meantime is a small body drying out. So the question about getting better anyway is answered by the claim’s own shape: it promises only to keep the child going while the illness passes.

Was there a fair test? Many. Doctors had long given fluid for dehydration straight into a vein, through a drip. One of the people who showed that a drink could do the job was a doctor called Dilip Mahalanabis. In 1971 cholera broke out among the refugees from what is now Bangladesh, crowded into a camp at Bangaon in India, with hardly any fluid for drips and two medical workers. He bought glucose, salt and baking soda in the local market, packed them in cellophane, a liter’s worth to a packet, and showed families how to give it with a cup and a spoon. The families begged for saline, the drip, so he called it oral saline. By one account, deaths in his camp were about a tenth as common as elsewhere, though nobody tossed a coin there, and it took years for doctors to accept. Later, trials put it against the drip directly. In 2006 reviewers for Cochrane gathered seventeen of them, with 1,811 children, in which chance, or something close to it, had decided who got which. Children given the drink did about as well as children given the drip, and left hospital about a day sooner. For every 25 children given the drink, one didn’t manage on it and needed a drip after all. The reviewers rated the trials as poor to moderate in quality, and said so.

That last part matters as much as the result. A real remedy can tell you how often it fails, and how good the evidence is, because someone counted. And it could have lost. In every one of those trials the drip, the best treatment there was, might have done clearly better. Who gains? Nobody is keeping it secret. Nepal makes its own, and the WHO names it in its advice on treating diarrhea, which by its count still kills about 440,000 children under five every year. None of that makes a page a substitute for a health worker. A baby with diarrhea, a child who won’t drink, or one who is getting worse needs to be seen.

So the questions are not a machine for saying no. They are the same questions, asked fairly, and a remedy that works can answer all of them. That is how anyone can tell it apart.

Three dots

Many of this site’s small pages of advice, on staying healthy, on first aid and much else, say under the title how strong the evidence behind them is, and for the evidence of research they use three dots.

Three filled dots mean strong evidence: many fair tests, added up, pointing the same way. Brushing twice a day with fluoride toothpaste has it, from a Cochrane review of many trials. Two dots mean moderate evidence: good tests, but fewer, or with results that vary, as with washing hands with soap, where handwashing programs in poorer countries cut diarrhea by about a quarter to a third. One dot means some evidence: a few studies, or ones that couldn’t rule out other explanations. Eating breakfast helps attention the same morning, most clearly in children who don’t get enough to eat, but the students who eat breakfast and do better at school may also come from richer homes, which could explain part of it.

Three empty dots say “not tested on its own”, and this is the mark most often misread. It doesn’t mean the advice is wrong. It means nobody has run a fair test of that exact advice by itself, so it rests on sense and on related evidence. Packing only what the day’s lessons need is like that: a review of studies with about 72,000 young people found no convincing evidence that a heavy bag causes back pain, and the studies were weak, so it isn’t proof that a heavy bag is harmless either. The advice is simply easier on you.

Many pages carry words without dots, because no study is the point. Official advice is what a health service, a regulator or the police says to do, and it is worth what their record is worth. Expert guidance is the standard advice of the people who teach a subject, and plain arithmetic means the sums settle it: no study is needed to show that saving a little each week adds up. Every one of these marks is a judgment, made by the people who wrote the page, from the sources listed at its foot. It can be wrong, and the sources are there so that anyone can check it. And the pages follow the rules this chapter asks of anyone: say how strong the evidence is, never promise a cure, never tell anyone to take a remedy or a supplement, and point to a doctor where it matters.

What the questions are for

All this could turn into a habit of doubting everything, and that fails too. Nobody can run a trial before taking a paracetamol, and nobody should have to. Most of what you know about health you will always take on trust, from parents, teachers, health workers and the people who study it. The eight questions are for the moment a claim asks something of you: to buy, to stop a treatment, to trust a stranger over your doctor, or to send it on to everyone you love.

And the card had a good ending. The ministry said plainly what was known, the newspapers carried it, and within a day the cards came off. Some of the most powerful people in the country, faced with better evidence, changed their minds and said so. That isn’t a failure of thinking clearly. It is what thinking clearly looks like.

Try it

Take It Apart

A post of our own, built on a real kind of claim that went round Nepal. Tap each question to see what it finds. Some find a lot, and one finds nothing at all.

A page you follow
Video · shared to you

Are your lungs healthy? Check now!

Hold your breath while the dot moves from A to B.

If you can, your lungs are healthy.

If you can’t, see a doctor.

Our own example, built on a real kind of post.

Tap a question to see what it finds in this post.

Asked 0 of 8.

Found a mistake? Please tell us.