Evidence map›Paper›PMID 21418648›Full record

SynthesisTrials2011

"Flogging dead horses": evaluating when have clinical trials achieved sufficiency and stability? A case study in cardiac rehabilitation.

Louise Dent, Rod Taylor, Kate Jolly, James Raftery

Abstract readMeta-AnalysisReview
In one paragraph

Synthesis in Trials, 2011. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 3 papers, 2 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
3citing papers in PubMed, 2 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

3 citing papers in PubMed, 2 syntheses or guidelines pooled it.

  1. Pooled it
  2. Pooled it
  3. Feasibility and effectiveness of remote, telephone-based delivery of cardiac rehabilitation.Telemedicine journal and e-health : the official journal of the American Telemedicine Association · 2014
    Trial
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

4 authors.

Louise DentUniversity of Southampton Clinical Trials Unit MP131, University of Southampton, SO16 6YD, UK. l.dent@soton.ac.uk
Rod Taylor
Kate Jolly
James Raftery

Funding

Department of Health
6 · The paper itself

Abstract

backgroundMost systematic reviews conclude that another clinical trial is needed. Measures of sufficiency and stability may indicate whether this is true.

objectivesTo show how evidence accumulated on centre-based versus home-based cardiac rehabilitation, including estimates of sufficiency and stability

methodsSystematic reviews of clinical trials of home versus centre-based cardiac rehabilitation were used to develop a cumulative meta-analysis over time. We calculated the standardised mean difference (SMD) in effect, confidence intervals and indicators of sufficiency and stability. Sufficiency refers to whether the meta-analytic database adequately demonstrates that an intervention works - is statistically superior to another. It does this by assessing the number of studies with null results that would be required to make the meta-analytic effect non-statistically significant. Stability refers to whether the direction and size of the effect is stable as new studies are added to the meta-analysis.

resultsThe standardised mean effect difference reduced over fourteen comparisons from a non-significant difference favouring home-based cardiac rehabilitation to a very small difference favouring hospital (SMD -0.10, 95% CI -0.32 to 0.13). This difference did not reach the sufficiency threshold (failsafe ratio 0.039<1) but did achieve the criteria for stability (cumulative slope 0.003<0.005).

conclusionsThe evidence points to a relatively small effect difference which was stable but not sufficient in terms of the suggested thresholds. Sufficiency should arguably be based on substantive significance and decided by patients. Research on patient preferences should be the priority. Sufficiency and stability measures are useful tools that need to be tested in further case studies.

Indexed as

Clinical Trials as TopicCommunity Health ServicesEvidence-Based MedicineHome Care ServicesOutpatient Clinics, HospitalData Interpretation, StatisticalHeart DiseasesHumansResearch DesignTreatment Outcome

Identifiers

PMID21418648
PMCPMC3073877

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.