Evidence map›Paper›PMID 34098952›Full record

ArticleBMC health services research2021

Development of an Implementation Process Model: a Delphi study.

Gillian Parker, Monika Kastner, Karen Born, Whitney Berta

Abstract read
In one paragraph

Article in BMC health services research, 2021. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 15 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
15citing papers in PubMed, 1 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

15 citing papers in PubMed, 1 synthesis or guideline pooled it.

  1. Pooled it
  2. The benefits and future potential of generative artificial intelligence (GAI) on mental health: a Delphi study.International journal of qualitative studies on health and well-being · 2026
    Article
  3. Article
  4. Article
  5. Repurposed drug prioritization pipeline for a multi-arm platform trial in clinical Alzheimer's disease.Alzheimer's & dementia : the journal of the Alzheimer's Association · 2026
    Article
  6. Article
  7. Article
  8. Article
  9. Article
  10. Article
  11. Article
  12. Article
  13. Article
  14. Article
  15. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

4 authors.

Gillian ParkerInstitute for Health Policy, Management and Evaluation, University of Toronto, 155 College Street, 4th Floor, Toronto, ON, M5T 3M6, Canada. gillian.parker@mail.utoronto.ca.
Monika KastnerInstitute for Health Policy, Management and Evaluation, University of Toronto, 155 College Street, 4th Floor, Toronto, ON, M5T 3M6, Canada.
Karen BornInstitute for Health Policy, Management and Evaluation, University of Toronto, 155 College Street, 4th Floor, Toronto, ON, M5T 3M6, Canada.
Whitney BertaInstitute for Health Policy, Management and Evaluation, University of Toronto, 155 College Street, 4th Floor, Toronto, ON, M5T 3M6, Canada.

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

backgroundThere is general scarcity of research on key elements of implementation processes and the factors which impact implementation success. Implementation of healthcare interventions is a complex process. Tools to support implementation can facilitate this process and improve effectiveness of the interventions and clinical outcomes. Understanding the impact of implementation support tools is a critical aspect of this process. The objective of this study was to solicit knowledge and agreement from relevant implementation science and knowledge translation healthcare experts in order to develop a process model of key elements in the implementation process.

methodsA two round, modified Delphi study involving international experts in knowledge translation and implementation (researchers, scientists, professors, decision-makers) was conducted. Participants rated and commented on all aspects of the process model, including the organization, content, scope, and structure. Delphi questions rated at 75% agreement or lower were reviewed and revised. Qualitative comments supported the restructuring and refinement. A second-round survey followed the same process as Round 1.

resultsFifty-four experts participated in Round 1, and 32 experts participated in Round 2. Twelve percent (n = 6) of the Round 1 questions did not reach agreement. Key themes for revision and refinement were: stakeholder engagement throughout the process, iterative nature of the implementation process; importance of context; and importance of using guiding theories or frameworks. The process model was revised and refined based on the quantitative and qualitative data and reassessed by the experts in Round 2. Agreement was achieved on all items in Round 2 and the Delphi concluded. Additional feedback was obtained regarding terminology, target users and definition of the implementation process.

conclusionsHigh levels of agreement were attained for all sub-domains, elements, and sub-elements of the Implementation Process Model. This model will be used to develop an Implementation Support Tool to be used by healthcare providers to facilitate effective implementation and improved clinical outcomes.

Indexed as

Delivery of Health CareHealth PersonnelDelphi TechniqueHumansSurveys and QuestionnairesTranslational Research, BiomedicalDelphiEvidence-basedHealth services researchImplementationModelProcess

Identifiers

PMID34098952
PMCPMC8183077

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.