Evidence map›Paper›PMID 25888928›Full record

SynthesisImplementation science : IS2015

Developing standards for reporting implementation studies of complex interventions (StaRI): a systematic review and e-Delphi.

Hilary Pinnock, Eleni Epiphaniou, Aziz Sheikh, Chris Griffiths, Sandra Eldridge, Peter Craig, Stephanie J C Taylor

Open access · goldAbstract readSystematic Review
In one paragraph

Synthesis in Implementation science : IS, 2015. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 70 papers, 10 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
70citing papers in PubMed, 10 pooled it
48.4field-weighted citation impact, top 1% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

70 citing papers in PubMed, 10 syntheses or guidelines pooled it, 135 citations in OpenAlex.

  1. Guideline
  2. Pooled it
  3. Pooled it
  4. Pooled it
  5. Pooled it
  6. Pooled it
  7. Methodological quality of behavioural weight loss studies: a systematic review.Obesity reviews : an official journal of the International Association for the Study of Obesity · 2016
    Pooled it
  8. Pooled it
  9. Pooled it
  10. Pooled it
  11. Trial
  12. Trial
  13. Article
  14. Article
  15. Article
  16. Article
  17. Characterizing Intervention Components and Complexity of Nonpharmacologic Healthcare Interventions to Manage Distress Behaviors in Older Adults.Journal of applied gerontology : the official journal of the Southern Gerontological Society · 2026
    Article
  18. Article
  19. Article
  20. Article

10 more citing papers are in PubMed but not listed here.

4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

7 authors at 3 institutions in 1 country.

Hilary PinnockAsthma UK Centre for Applied Research, Allergy and Respiratory Research Group, Centre for Population Health Sciences, University of Edinburgh, Doorway 3, Medical School, Teviot Place, Edinburgh, EH8 9AG, Scotland, UK. hilary.pinnock@ed.ac.uk.
Eleni EpiphaniouCentre for Primary Care and Public Health, Blizard Institute, Barts and The London School of Medicine and Dentistry, London, UK. e.epiphaniou@qmul.ac.uk.
Aziz SheikhAsthma UK Centre for Applied Research, Allergy and Respiratory Research Group, Centre for Population Health Sciences, University of Edinburgh, Doorway 3, Medical School, Teviot Place, Edinburgh, EH8 9AG, Scotland, UK. aziz.sheikh@ed.ac.uk.
Chris GriffithsCentre for Primary Care and Public Health, Blizard Institute, Barts and The London School of Medicine and Dentistry, London, UK. c.j.griffiths@qmul.ac.uk.
Sandra EldridgePragmatic Clinical Trials Unit, Centre for Primary Care and Public Health, Blizard Institute, Barts and The London School of Medicine and Dentistry, London, UK. s.eldridge@qmul.ac.uk.
Peter CraigMRC/CSO Social and Public Health Sciences Unit, University of Glasgow, Glasgow, UK. peter.craig@glasgow.ac.uk.
Stephanie J C TaylorCentre for Primary Care and Public Health, Blizard Institute, Barts and The London School of Medicine and Dentistry, London, UK. s.j.c.taylor@qmul.ac.uk.
Queen Mary University of London · GBCentre for Inflammation Research · GBMRC/CSO Social and Public Health Sciences Unit · GB

Funding

Chief Scientist Office PCRCA/08/01Chief Scientist Office SPHSU1Department of Health 11/1014/04Medical Research Council MC_UU_12017/15Medical Research Council MC_UU_12017/4
6 · The paper itself

Abstract

backgroundDissemination and implementation of health care interventions are currently hampered by the variable quality of reporting of implementation research. Reporting of other study types has been improved by the introduction of reporting standards (e.g. CONSORT). We are therefore developing guidelines for reporting implementation studies (StaRI).

methodsUsing established methodology for developing health research reporting guidelines, we systematically reviewed the literature to generate items for a checklist of reporting standards. We then recruited an international, multidisciplinary panel for an e-Delphi consensus-building exercise which comprised an initial open round to revise/suggest a list of potential items for scoring in the subsequent two scoring rounds (scale 1 to 9). Consensus was defined a priori as 80% agreement with the priority scores of 7, 8, or 9.

resultsWe identified eight papers from the literature review from which we derived 36 potential items. We recruited 23 experts to the e-Delphi panel. Open round comments resulted in revisions, and 47 items went forward to the scoring rounds. Thirty-five items achieved consensus: 19 achieved 100% agreement. Prioritised items addressed the need to: provide an evidence-based justification for implementation; describe the setting, professional/service requirements, eligible population and intervention in detail; measure process and clinical outcomes at population level (using routine data); report impact on health care resources; describe local adaptations to the implementation strategy and describe barriers/facilitators. Over-arching themes from the free-text comments included balancing the need for detailed descriptions of interventions with publishing constraints, addressing the dual aims of reporting on the process of implementation and effectiveness of the intervention and monitoring fidelity to an intervention whilst encouraging adaptation to suit diverse local contexts.

conclusionsWe have identified priority items for reporting implementation studies and key issues for further discussion. An international, multidisciplinary workshop, where participants will debate the issues raised, clarify specific items and develop StaRI standards that fit within the suite of EQUATOR reporting guidelines, is planned. REGISTRATION: The protocol is registered with Equator: http://www.equator-network.org/library/reporting-guidelines-under-development/#17 .

Indexed as

Diffusion of InnovationDelphi TechniqueHealth Services ResearchHumansProgram DevelopmentTranslational Research, Biomedical

Identifiers

PMID25888928
PMCPMC4393562
OpenAlexW1997318649

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.