Evidence map›Paper›PMID 24021722›Full record

ArticleBMJ (Clinical research ed.)2013

Poor description of non-pharmacological interventions: analysis of consecutive sample of randomised trials.

Tammy C Hoffmann, Chrissy Erueti, Paul P Glasziou

Abstract read
In one paragraph

Article in BMJ (Clinical research ed.), 2013. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 155 papers, 40 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
155citing papers in PubMed, 40 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

155 citing papers in PubMed, 40 syntheses or guidelines pooled it.

  1. Pooled it
  2. Pooled it
  3. A meta-analysis of the effect of visiting zoos and aquariums on visitors' conservation knowledge, beliefs, and behavior.Conservation biology : the journal of the Society for Conservation Biology · 2025
    Pooled it
  4. Pooled it
  5. Pooled it
  6. Pooled it
  7. Pooled it
  8. Pooled it
  9. Pooled it
  10. Remote care through telehealth for people with inflammatory bowel disease.The Cochrane database of systematic reviews · 2023
    Pooled it
  11. Pooled it
  12. Pooled it
  13. Pooled it
  14. Pooled it
  15. Pooled it
  16. Pooled it
  17. Pooled it
  18. Pooled it
  19. Pooled it
  20. Pooled it

95 more citing papers are in PubMed but not listed here.

4 · The record

Corrections and comments

5 · Who and what money

Authors and funding

3 authors.

Tammy C HoffmannCentre for Research in Evidence-Based Practice, Faculty of Health Sciences and Medicine, Bond University, Qld, Australia, 4229.
Chrissy Erueti
Paul P Glasziou

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

objectivesTo evaluate the completeness of descriptions of non-pharmacological interventions in randomised trials, identify which elements are most frequently missing, and assess whether authors can provide missing details.

designAnalysis of consecutive sample of randomised trials of non-pharmacological interventions. DATA SOURCES AND STUDY SELECTION: All reports of randomised trials of non-pharmacological interventions published in 2009 in six leading general medical journals; 133 trial reports, with 137 interventions, met the inclusion criteria. DATA COLLECTION: Using an eight item checklist, two raters assessed the primary full trial report, plus any reference materials, appendices, or websites. Questions about missing details were emailed to corresponding authors, and relevant items were then reassessed.

resultsOf 137 interventions, only 53 (39%) were adequately described; this was increased to 81 (59%) by using 63 responses from 88 contacted authors. The most frequently missing item was the "intervention materials" (47% complete), but it also improved the most after author response (92% complete). Whereas some authors (27/70) provided materials or further information, other authors (21/70) could not; their reasons included copyright or intellectual property concerns, not having the materials or intervention details, or being unaware of their importance. Although 46 (34%) trial interventions had further information or materials readily available on a website, many were not mentioned in the report, were not freely accessible, or the URL was no longer functioning.

conclusionsMissing essential information about interventions is a frequent, yet remediable, contributor to the worldwide waste in research funding. If trial reports do not have a sufficient description of interventions, other researchers cannot build on the findings, and clinicians and patients cannot reliably implement useful interventions. Improvement will require action by funders, researchers, and publishers, aided by long term repositories of materials linked to publications.

Indexed as

Biomedical ResearchHumansRandomized Controlled Trials as TopicResearch Report

Identifiers

PMID24021722
PMCPMC3768250

What OpenQuestion holds

Textmetadata
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.