The Field Guide · No. 14

Why nutrition studies keep contradicting each other

Diet headlines reverse so often because most rest on observational studies with tiny effects and countless confounders, so the same food gets linked to both harm and benefit.

Eggs are deadly. Eggs are fine. Coffee causes cancer. Coffee prevents it. A glass of wine adds years. A glass of wine takes them. If you feel jerked around by food news, you are paying attention. The reversals are usually not scientists being sloppy. They come from the kind of study most nutrition claims are built on.

Almost all diet research is observational. Researchers ask big groups of people what they eat, then watch who gets sick years later. They cannot randomly assign you to eat bacon for a decade, so they study the choices you already made. And people who eat a lot of any one food differ in a hundred other ways: money, exercise, smoking, sleep, how often they see a doctor. Any of those could be the real cause, and no amount of statistics fully untangles them. On top of that, most true diet effects are small, and small effects are exactly the ones that flip sign from one study to the next.

There is a lovely study that makes the point. Two researchers picked fifty random ingredients from a cookbook and looked up whether each had been tied to cancer. Almost all of them had. Most single studies claimed the food raised or lowered cancer risk, yet three-quarters of those estimates rested on weak or no real statistical significance. When the results were pooled properly in meta-analyses, the dramatic effects mostly shrank toward nothing. The individual papers were a coin-flip of scary and reassuring headlines. The combined picture was a shrug.

So how do you read diet news without the whiplash? Discount the single study, especially a splashy one about one food. Wait for meta-analyses and for advice that has held up for years, the boring stuff: mostly plants, not too much, go easy on ultra-processed food. And treat any headline promising that one ingredient will save you or doom you as almost certainly overstated. The real effect of most single foods is small, and small is not what sells a headline.

What to remember

From the record

Many single studies highlight implausibly large effects, even though evidence is weak. Effect sizes shrink in meta-analyses.

Jonathan D. Schoenfeld, John P. A. Ioannidis Is everything we eat associated with cancer? A systematic cookbook review, The American Journal of Clinical Nutrition, 2013

Asked often

Why does nutrition advice keep changing?

Because most of it comes from observational studies, which can only show that a food and an outcome go together, not that one causes the other. The people who eat a given food differ in many other ways, and the true effect of most single foods is small. Small effects tangled with confounders are exactly the kind that flip from one study to the next.

Should I ignore nutrition studies then?

Not ignore, just discount the single ones. One study about one food, especially a dramatic one, is weak evidence. Look instead for meta-analyses that pool many studies, and for advice that has stayed stable for years. The unglamorous basics have held up precisely because they are not built on a lone headline.

Read the news better, every morning.

We send you the day's real progress in science, medicine and beyond, told plainly and sourced. Free, forever.