Evidence map›Paper›PMID 11860604›Full record

ArticleBMC medical research methodology2002

Simpson's paradox and calculation of number needed to treat from meta-analysis.

Christopher J Cates

Abstract read
In one paragraph

Article in BMC medical research methodology, 2002. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 55 papers, 36 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
55citing papers in PubMed, 36 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

55 citing papers in PubMed, 36 syntheses or guidelines pooled it.

  1. Pooled it
  2. Peripheral nerve blocks for hip fractures in adults.The Cochrane database of systematic reviews · 2020
    Pooled it
  3. Pooled it
  4. Pooled it
  5. Pooled it
  6. Pooled it
  7. Pooled it
  8. Pooled it
  9. Pooled it
  10. Pooled it
  11. Peripheral nerve blocks for hip fractures.The Cochrane database of systematic reviews · 2017
    Pooled it
  12. Pooled it
  13. Pooled it
  14. Pooled it
  15. Pooled it
  16. Sub-Tenon's anaesthesia versus topical anaesthesia for cataract surgery.The Cochrane database of systematic reviews · 2015
    Pooled it
  17. Statins and Cardiovascular Primary Prevention in CKD: A Meta-Analysis.Clinical journal of the American Society of Nephrology : CJASN · 2015 · on this map
    Pooled it
  18. Common harms from amoxicillin: a systematic review and meta-analysis of randomized placebo-controlled trials for any indication.CMAJ : Canadian Medical Association journal = journal de l'Association medicale canadienne · 2015
    Pooled it
  19. Pooled it
  20. Pooled it
4 · The record

Corrections and comments

5 · Who and what money

Authors and funding

1 author.

Christopher J CatesManor View Surgery, Bushey Health Centre, London Road, Bushey, Watford, UK. chriscates@email.msn.com

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

backgroundCalculation of numbers needed to treat (NNT) is more complex from meta-analysis than from single trials. Treating the data as if it all came from one trial may lead to misleading results when the trial arms are imbalanced. DISCUSSION: An example is shown from a published Cochrane review in which the benefit of nursing intervention for smoking cessation is shown by formal meta-analysis of the individual trial results. However if these patients were added together as if they all came from one trial the direction of the effect appears to be reversed (due to Simpson's paradox). Whilst NNT from meta-analysis can be calculated from pooled Risk Differences, this is unlikely to be a stable method unless the event rates in the control groups are very similar. Since in practice event rates vary considerably, the use a relative measure, such as Odds Ratio or Relative Risk is advocated. These can be applied to different levels of baseline risk to generate a risk specific NNT for the treatment. SUMMARY: The method used to calculate NNT from meta-analysis should be clearly stated, and adding the patients from separate trials as if they all came from one trial should be avoided.

Indexed as

Meta-Analysis as TopicBiasClinical Trials as TopicData Interpretation, StatisticalHumansOdds RatioReproducibility of ResultsSample SizeSmoking CessationStatistics as Topic

Identifiers

PMID11860604
PMCPMC65632

What OpenQuestion holds

Textmetadata
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.