Evidence map›Paper›PMID 31159786›Full record

Trial reportBMC medicine2019

Three randomized controlled trials evaluating the impact of "spin" in health news stories reporting studies of pharmacologic treatments on patients'/caregivers' interpretation of treatment benefit.

Isabelle Boutron, Romana Haneef, Amélie Yavchitz, Gabriel Baron, John Novack, Ivan Oransky, Gary Schwitzer, Philippe Ravaud

Erratum issued 3 registry-linked trialsAbstract readRandomized Controlled Trial
In one paragraph

Trial report in BMC medicine, 2019. The graph could read no effect estimate from its abstract, so it casts no vote on the map. An erratum has been issued. It is linked to 3 registered trials, which are not on this map. Cited by 21 papers, 4 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
21citing papers in PubMed, 4 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

NCT03094078 nacompletednot on this map

Interpretation of Health News Items Reporting Results of Pre-clinical Studies With or Without Spin: A Randomized Controlled Trial Among English-speaking Patients

TypeinterventionalSponsorAssistance Publique - Hôpitaux de ParisRan2017 to 2017Enrolled300ConditionsThe Study Focus on no Specific ConditionArmsNews item with spin, News item without spin
NCT03094104 naunknown statusnot on this map

Interpretation of Health News Items Reporting Results of Phase I/II (Non-randomized) Trials With or Without Spin: A Randomized Controlled Trial Among English-speaking Population

TypeinterventionalSponsorAssistance Publique - Hôpitaux de ParisRan2019 to 2019Enrolled300ConditionsThe Study Focus on no Specific ConditionArmsNews items with spin, News items without spin
NCT03095586 nacompletednot on this map

Interpretation of Health News Items Reporting Results of Randomized Controlled Trials With or Without Spin: A Randomized Controlled Trial Among English-speaking Patients

TypeinterventionalSponsorAssistance Publique - Hôpitaux de ParisRan2017 to 2017Enrolled300ConditionsThe Study Focus on no Specific ConditionArmsNews items with spin, News items without spin
3 · Its place in the literature

Who cites it

21 citing papers in PubMed, 4 syntheses or guidelines pooled it.

  1. Pooled it
  2. Pooled it
  3. Pooled it
  4. Pooled it
  5. Article
  6. Article
  7. Article
  8. Article
  9. Caught in the Web of Words: Do LLMs Fall for Spin in Medical Literature?Proceedings of machine learning research · 2025
    Article
  10. Review
  11. Spin in dental publications: a scoping review.Brazilian oral research · 2024
    Article
  12. Article
  13. Article
  14. Article
  15. Article
  16. Article
  17. Defining and detecting fake news in health and medicine reporting.Journal of the Royal Society of Medicine · 2020
    Article
  18. Article
  19. Article
  20. Article
4 · The record

Corrections and comments

5 · Who and what money

Authors and funding

8 authors.

Isabelle BoutronINSERM, UMR 1153, Epidemiology and Biostatistics Research Center (CRESS), Methods Team, Paris, France. isabelle.boutron@aphp.fr.
Romana HaneefINSERM, UMR 1153, Epidemiology and Biostatistics Research Center (CRESS), Methods Team, Paris, France.
Amélie YavchitzINSERM, UMR 1153, Epidemiology and Biostatistics Research Center (CRESS), Methods Team, Paris, France.
Gabriel BaronCentre d'Épidémiologie Clinique, AP-HP (Assistance Publique des Hôpitaux de Paris), Hôpital Hôtel Dieu, 1, Place du parvis Notre Dame, 75004, Paris Cedex 4, France.
John NovackInspire, Arlington, VA, USA.
Ivan OranskyNew York University's Arthur Carter Journalism Institute, New York, USA.
Gary SchwitzerHealthNewsReview.org, University of Minnesota, School of Public Health, Minneapolis, MN, USA.
Philippe RavaudINSERM, UMR 1153, Epidemiology and Biostatistics Research Center (CRESS), Methods Team, Paris, France.

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

backgroundNews stories represent an important source of information. We aimed to evaluate the impact of "spin" (i.e., misrepresentation of study results) in health news stories reporting studies of pharmacologic treatments on patients'/caregivers' interpretation of treatment benefit.

methodsWe conducted three two-arm, parallel-group, Internet-based randomized trials (RCTs) comparing the interpretation of news stories reported with or without spin. Each RCT considered news stories reporting a different type of study: (1) pre-clinical study, (2) phase I/II non-RCT, and (3) phase III/IV RCT. For each type of study, we identified news stories reported with spin that had earned mention in the press. Two versions of the news stories were used: the version with spin and a version rewritten without spin. Participants were patients/caregivers involved in Inspire, a large online community of more than one million patients/caregivers. The primary outcome was participants' interpretation assessed by one specific question "What do you think is the probability that 'treatment X' would be beneficial to patients?" (scale, 0 [very unlikely] to 10 [very likely]).

resultsFor each RCT, 300 participants were randomly assigned to assess a news story with spin (n = 150) or without spin (n = 150), and 900 participants assessed a news story. Participants were more likely to consider that the treatment would be beneficial to patients when the news story was reported with spin. The mean (SD) score for the primary outcome for abstracts reported with and without spin for pre-clinical studies was 7.5 (2.2) versus 5.8 (2.8) (mean difference [95% CI] 1.7 [1.0-2.3], p < 0.001); for phase I/II non-randomized trials, 7.6 (2.2) versus 5.8 (2.7) (mean difference 1.8 [1.0-2.5], p < 0.001); and for phase III/IV RCTs, 7.2 (2.3) versus 4.9 (2.8) (mean difference 2.3 [1.4-3.2], p < 0.001).

conclusionsSpin in health news stories reporting studies of pharmacologic treatments affects patients'/caregivers' interpretation.

trial registrationClinicalTrials.gov, NCT03094078 , NCT03094104 , NCT03095586.

Indexed as

CommunicationData AccuracyPerceptionAdolescentAdultAgedAttitude to HealthCaregiversClinical Trials, Phase I as TopicClinical Trials, Phase II as TopicClinical Trials, Phase III as TopicClinical Trials, Phase IV as TopicDrug Evaluation, PreclinicalDrug TherapyFemaleHumansDetrimental research practicesDistorted interpretationRandomized trialSpin

Identifiers

PMID31159786
PMCPMC6547451

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.