How to Fact-Check a News Article That Cites a Study
To fact-check a news article about a study, find the original paper, compare its abstract with the article's wording, check how big the effect was, and confirm who was studied (people, animals or cells). Watch for 'proves' where the paper says 'is associated with'.
- Find the original paper, not just the press release.
- Compare the abstract's wording with the article's.
- Check the size of the effect.
- Check who or what was studied.
- Watch for causal claims from observational data.
Fact-checking a news article that cites a study means comparing the article's claims with what the paper itself reports. Common distortions include stating cause when the study found only an association, applying animal results to people, and giving advice the authors did not. Research led by Petroc Sumner, published in the BMJ in 2014 and later replicated, found that many such exaggerations already appear in university press releases.
The headline is bold and the article quotes an author. Two weeks later someone points out that the study showed something narrower and weaker. You can check this yourself, usually in a few minutes, without a statistics background.
How do you find the original study behind a news story?
The article should link to the study or at least name it. If it does not, that is a flag — many articles are based on press releases, not on the actual paper. Search for the lead author plus a key term from the article. Many papers can be found on Google Scholar or, for health research, PubMed. If the only source is a press release with no paper, treat the claim as preliminary at best.
How do you compare a news article with the study's abstract?
The abstract is the authors' own summary of what they found. Compare it to the article. Look specifically for: did the article add words like "proves" or "shows definitively" when the abstract said "suggests" or "is associated with"? Did the article skip the population the study was about? Did it generalize a finding from mice to humans? These translation errors are among the most common forms of misreporting.
How do you tell if a news story exaggerates a study's results?
An article that says "this drug cures the disease" and a study that says "this drug reduced symptom score by 8 percent" are not telling you the same thing. Look at the effect size in the paper and the size of the claim in the article. If the article uses absolute language for a modest effect, you have been misled, even if technically nothing was a lie.
Does a study apply to people like you?
A study on 60-year-old men with heart disease does not apply to 30-year-old healthy women. A study on cells in a dish does not apply to humans yet. A study on rats may or may not apply to humans. The article often loses this nuance — "studies show coffee prevents dementia" when the study was on people who already had risk factors. Check who the participants were and whether you are one of them.
What are the most common ways news misreports studies?
Three show up again and again, and researchers studying health news have tracked all three: causal claims based on observational data ('coffee prevents dementia' when the study found coffee drinkers had lower rates), claims about humans based on animal or cell studies, and advice the study never gave ('you should eat more X'). Place the article and the abstract side by side and look for each one. Also check what the article leaves out: the sample size, the limitations the authors listed, and whether this is one study or part of a larger body of evidence.
Sources
Read the paper, not just the headline.
Paste a paper URL, abstract, or PDF and Research Decoder gives you the one-sentence finding, methodology, limitations, and an honest "so what" — plus a Media Check that flags how the news got it wrong.
Found this useful? Link to it.
https://deftbrain.com/guides/learning/how-to-fact-check-a-news-article-that-cites-a-study
Free to read, no account, no paywall — link away.