Evidence map›Paper›PMID 41882754›Full record

ArticleImplementation science communications2026

Development and preliminary evaluation of the Implementation Research Proposal Appraisal Criteria (ImpResPAC) tool: an international expert modified e-Delphi study.

Louise Hull, Chloe Sweetnam, Rachel E Davis, Zarnie Khadjesari, Andy Healey, Annette Boaz, Ioannis Bakolis, Nick Sevdalis, Lucy Goulding, ImpResPAC Expert Advisory Panel

Abstract read
In one paragraph

Article in Implementation science communications, 2026. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Not yet cited in PubMed.

0numbers the graph read from it
0cells of the map it votes in
0citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

0 citing papers in PubMed.

No citing paper in PubMed yet.

4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

10 authors.

Louise Hull *Centre for Mental Health Policy and Evaluation, Health Service and Population Research Department, King's College London, London, UK. lmh68@leicester.ac.uk.ORCID http://orcid.org/0000-0003-4660-4005
Chloe Sweetnam *, Petauri Kinect, NY, USA.
Rachel E DavisPatient-Centred Research Group, Part of Thermofisher Scientific, Evidera, Inc PPD, London, UK.
Zarnie KhadjesariBehavioural and Implementation Science (BIS) Research Group, School of Health Sciences, University of East Anglia, Norwich, UK.
Andy HealeyCentre for Mental Health Policy and Evaluation, Health Service and Population Research Department, King's College London, London, UK.
Annette BoazHealth and Social Care Workforce Research Unit, The Policy Institute, King's College London, London, UK.
Ioannis BakolisCentre for Mental Health Policy and Evaluation, Health Service and Population Research Department, King's College London, London, UK.
Nick SevdalisCentre for Behavioural and Implementation Science Interventions, Yong Loo Lin School of Medicine, National University of Singapore, Singapore, Singapore.
Lucy GouldingUCLPartners, London, UK.
ImpResPAC Expert Advisory Panel

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

backgroundHigh-quality implementation research is fundamental to increasing the uptake of evidence-based interventions in healthcare and ultimately improving healthcare delivery and outcomes. However, the development of high-quality implementation research proposals and the identification of the 'best' implementation research proposals to fund are hampered by the lack of criteria for their appraisal. This study describes the development and evaluation of the Implementation Research Proposal Appraisal Criteria (ImpResPAC), a comprehensive tool developed to help research teams identify strengths and weaknesses of their implementation research proposals and provide grant reviewers with clear criteria for appraising the conceptual and methodological quality of implementation research proposals.

methodsA two-stage sequential mixed-methods design, including content development (stage 1) and a two-round modified e-Delphi (stage 2a & 2b), was employed. Stage 1: Informed by the structure and content of the Implementation Science Research Development (ImpRes) tool and supplementary guide, and a previous study in which five of the ten ImpRes domains were operationalised to develop five ImpResPAC domains, the ImpResPAC development team developed the initial content of ImpResPAC. Purposive and snowball sampling was used to recruit an Expert Advisory Panel (EAP), of individuals that have made a significant contribution to the conceptual and methodological advancement of implementation science. Stage 2a: The EAP provided feedback on ImpResPAC. Based on the feedback, the ImpResPAC development team made extensive revisions to ImpResPAC. Stage 2b: The refined ImpResPAC was shared with the EAP for further feedback and evaluation.

resultsSixty-eight international experts formed the EAP. ImpResPAC includes 71 domain items, each indicative of high-quality implementation research. The domain items are organised over 10 domains each representing a core element of implementation research. Based on feedback, user instructions were refined, and a glossary of terms used in ImpResPAC was developed.

conclusionImpResPAC is a comprehensive and transparent quantitative tool to appraise the conceptual and methodological quality of implementation research proposals in healthcare. Application of ImpResPAC has several potential and immediate benefits; it will support research teams identify strengths and weaknesses of their implementation research proposals and in turn develop high-quality proposals, enable grant reviewers to identify the 'best' implementation research proposals to fund, and provide a comprehensive tool to be used by educators to appraise implementation research proposals submitted as part of implementation science teaching and training initiatives.

Indexed as

Appraisal criteriaImplementation evaluationImplementation proposalsImplementation protocolsImplementation researchImplementation scienceQuality appraisalReview criteria

Identifiers

PMID41882754
PMCPMC13390299

What OpenQuestion holds

Textmetadata
LicenceCC BY-NC-ND
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.