Evidence map›Paper›PMID 31757840›Full record

ArticleBMJ evidence-based medicine2020

Trial design for ineffectiveness research: a mixed-methods survey.

Kevin Riggs, Joshua Richman, Stefan Kertesz

Open access · greenAbstract read
In one paragraph

Article in BMJ evidence-based medicine, 2020. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Not yet cited in PubMed.

0numbers the graph read from it
0cells of the map it votes in
0citing papers in PubMed
–field-weighted citation impact, top 72% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

0 citing papers in PubMed, 0 citations in OpenAlex.

No citing paper in PubMed yet.

4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

3 authors at 1 institution in 1 country.

Kevin RiggsMedicine, University of Alabama School of Medicine, Birmingham, Alabama, USA kriggs@uab.edu.ORCID 0000-0002-0015-5809
Joshua RichmanBirmingham VA Medical Center, Birmingham, Alabama, United States.
Stefan KerteszMedicine, University of Alabama School of Medicine, Birmingham, Alabama, USA.
University of Alabama at Birmingham · US

Funding

UAB K12 in Patient Centered Outcomes ResearchK12HS023009 · AHRQ · UNIVERSITY OF ALABAMA AT BIRMINGHAM · PI SAAG, KENNETH G · 2014 to 2018
$4.0M
AHRQ HHS K12 HS023009
6 · The paper itself

Abstract

High-quality research demonstrating a lack of effectiveness may facilitate the 'de-adoption' of ineffective health services. However, there has been little debate on the optimal design for ineffectiveness research-studies exploring the research hypothesis that an intervention is ineffective. The aim of this study was to explore investigators' preferences for trial design for ineffectiveness research. We conducted a mixed-methods online survey with principle investigators identified from clinicaltrials.gov. A vignette described researchers planning a trial to test a widely used intervention they hypothesised was ineffective. One multiple-choice question asked whether a superiority trial or equivalence trial design was favoured, and one free-response question asked about the reasons for that choice. Free-response answers were analysed using content analysis to identify related reasons. 139 participants completed the survey (completion rate 37.5%). Overall, 56.8% favoured superiority trials, 27.3% favoured equivalence trials and 15.8% were unsure. Reasons identified for favouring superiority trials were: (1) evidence of superiority should be required to justify active treatment, (2) superiority trials are more familiar, (3) placebo should not be the comparator in equivalence trials and (4) superiority trials require smaller sample sizes. Reasons identified for favouring equivalence trials were: (1) negative superiority trials represent a lack of evidence of effectiveness, not evidence of ineffectiveness and (2) the research hypothesis should not be the same as the null hypothesis. A minority of experienced researchers favour equivalence trials for ineffectiveness research, and misconceptions and lack of familiarity with equivalence trials may be contributing factors.

Indexed as

Treatment OutcomeAttitude of Health PersonnelClinical Trials as TopicEquivalence Trials as TopicFemaleHumansMaleMiddle AgedRandomized Controlled Trials as TopicResearch DesignSurveys and Questionnairesclinical trial designcomparative effectiveness researchineffectiveness researchoveruse

Identifiers

PMID31757840
PMCPMC9097110
OpenAlexW2990903801

What OpenQuestion holds

Textmetadata
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.