ArticleAdministration and policy in mental health2011
Outcomes for implementation research: conceptual distinctions, measurement challenges, and research agenda.
69 registry-linked trialsAbstract read
In one paragraph
Article in Administration and policy in mental health, 2011. The graph could read no effect estimate from its abstract, so it casts no vote on the map. It is linked to 69 registered trials, which are not on this map. Cited by 4,711 papers, 11 of them syntheses that pooled it.
0numbers the graph read from it
0cells of the map it votes in
4,711citing papers in PubMed, 11 pooled it
–field-weighted citation impact
What it found
Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.
The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.
The trial behind it
Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.
Developing and Testing Implementation Strategies for Evidence-Based Obesity Prevention in Childcare
A Hybrid Effectiveness-Implementation Trial of a Complex Multiple Risk Intervention to Promote Healthy Behaviors in People Between 45 to 75 Years Attended in Primary Health Care
Building and Sustaining Interventions for Children (BASIC): Task-sharing Mental Health Care in Low-resource Settings
Pilot Project to Better Understand Non-Clinical Needs of Cancer Patients
A Pairwise Randomized Study on Implementation of Guidelines and Evidence Based Treatments of Psychoses
Supporting and Enhancing NICU Sensory Experiences to Optimize Developmental Outcomes in Preterm Infants
Type 2 Diabetes Prevention in Community Health Care Settings for at Risk Children and Mothers
A Cluster Randomized Clinical Trial to Evaluate the Effectiveness of a Multifaceted Knowledge Translation Intervention in Hospitalized Infants: the Implementation of Infant Pain Practice Change (ImPaC) Resource
Feasibility of a Stroke Specific Self-management Program
Peer-Delivered Behavioral Activation Intervention to Improve Adherence to MAT Among Low-Income, Minority Individuals With OUD - Pilot Phase
NCT04356274 naenrolling by invitationnot on this mapstarted 2019, after this paper: background citation
Participatory System Dynamics vs Audit and Feedback: A Cluster Randomized Trial of Mechanisms of Implementation Change to Expand Reach of Evidence-based Addiction and Mental Health Care
Choose to Move: How Can Health Benefits of an Effective, Scaled-up, Health Promotion Model for Older Adults be Sustained?
Enhancing Rural Health Via Cardiovascular Telehealth for Rural Patients (E-VICTORS) Project
An Implementation Study of Suicide Risk Management Among Discharged Psychiatric Patients Based on Brief Contact Interventions and Sequential Multiple Assignment Randomized Trial
NCT04921787 naactive not recruitingnot on this mapstarted 2021, after this paper: background citation
Exemplar Hospital Initiation Trial to Enhance Treatment Engagement - Implementation Trial of High Intensity Versus Low Intensity Strategy for Supporting Hospital-Based Opioid Use Disorder Treatment
Addressing Provider Stress and Unconscious Bias to Improve Quality of Maternal Health Care
Symptom-Targeted Approach to Rehabilitation for Concussion: STAR-C
CATCH-UP Vaccines: Extension of Community - Engaged Approaches to Testing in Community and Healthcare Settings for Underserved Populations
Implementing Long-Acting Novel Antiretrovirals - the ILANA Study
Peer-Delivered Behavioral Activation Intervention to Improve Adherence to MT Among Low-Income, Minority Individuals With OUD
INSPIRE: Feasibility of a Community-based Integrated Care Model for Older Adults Living at Home
Help Optimise and Mobilise Elders (H.O.M.E)
NCT05527392 naactive not recruitingnot on this mapstarted 2023, after this paper: background citation
Assessing the Effect of Virtual Navigation Interventions to Improve Health Insurance Literacy and Decrease Financial Burden: A Childhood Cancer Survivor Study Randomized Trial (HINTII)
Feasibility and Usability of Mobile Applications for Monitoring Cutaneous Leishmaniasis Treatment in Colombia: 2019-2021
A Novel Approach to Endometriosis Treatment: Piloting an Interdisciplinary Group Care Model
Implementing Advanced Care Planning in the Routine Care for Acutely Admitted Patients in Geriatric Units: a Cluster Randomised Controlled Trial
Resonance Breathing Opioid Use Disorder
Caring for Caregivers and People Living With Dementia Under Home-Based Primary Care
Train Your Brain: A Pilot Project to Improve Memory and Decision Making to Improve Outcomes Among Youth
Peer-Delivered, Behavioral Activation Intervention to Improve Polysubstance Use and Retention in Mobile Telemedicine OUD Treatment in an Underserved, Rural Area
Reducing Empiric VAncomycin Use in Pediatric Suspected Sepsis (REVAMP-Sepsis)
Rigorous Evaluation of the READY to Stand Curriculum as a Tool to Prevent the Commercial Sexual Exploitation of Children Among Racially and Ethnically Diverse Urban Youth (PHASE II: OPEN PILOT TRIAL)
Helping People Adhere to Their Varenicline Treatment by Co-creating a Conversational Agent: A Feasibility Study
AURORA Study-A Transformative Approach Utilizing Behavioral Economics, Education, and Data Science to Support Patients Initiating PrEP With Retention-in-care and Medication Persistence
Caring for Providers to Improve Patient Experience (CPIPE) Study: A Cluster Randomized-controlled Trial to Assess the Impact of the CPIPE Intervention on Person-centered Maternity Care
BE-EMPOWERed Study: Belgian Study Enhancing the Uptake and the Effectiveness of a Multifactorial Falls Prevention Intervention in Older Community-dWElling peRsons
Peer Delivered Episodic Future Thinking to Improve MOUD Treatment Engagement Among Returning Citizens - A Randomized Controlled Trial
Evaluating a National Person-Centered Training Program to Strengthen the Dementia Care Workforce
NCT06243068 naenrolling by invitationnot on this mapstarted 2024, after this paper: background citation
Improving Shared Decision-Making and Access to Non-Dialytic Treatment for People With Kidney Disease (The ExPAND Trial)
NCT06252259 naenrolling by invitationnot on this mapstarted 2024, after this paper: background citation
Choose to Move (CTM): Implementation and Impact Evaluation of an Adapted Health-Promoting Program for Equity-Deserving Older Adults
Identifying & Addressing Unmet Needs of Injury Survivors at a Safety Net Hospital in San Francisco
ASHA Bangladesh--An Integrated Intervention to Address Depression in Low Income Rural Women
Dissemination, Acceptability and Adaptation Study of Two Transdiagnostic Psychological Interventions Based on Emotional Regulation (ER) for the Treatment of Alcohol Addiction: Dialectical Behavioral Therapy(DBT) and Unified Protocol (UP)
Postnatal Care and Services Utilization in Nepal: Use of mHealth Intervention in Improving Utilization of Postpartum Care
NCT06411223 phase2active not recruitingnot on this mapstarted 2024, after this paper: background citation
Project Tara: Pharmacist-led Intervention for Injectable HIV Treatment for Women With Health-related Social Needs
NCT06434298 naenrolling by invitationnot on this mapstarted 2023, after this paper: background citation
Continued Evaluation of Provincial Scale-up of Choose to Move (CTM) Phase 4
NCT06446414 naenrolling by invitationnot on this mapstarted 2023, after this paper: background citation
Provincial Scale-up of Choose to Move: Implementation and Impact Evaluation of an Adapted Health-Promoting Program for Equity-Deserving Older Adults
Implementing BEAM: An mHealth Tool to Prevent Mental Health Problems and Improve Developmental Outcomes in Young Children
Evaluation of an mHealth Intervention Using an Automated Text Message (SMS) Invitation System to Increase Participation in Mammography Screening Among Women Aged 50-69 Years in the Province of Santa Fe, Argentina
Implementing the National Frailty Policy in Singapore's Primary Care: A Pilot Feasibility Study of The Intrinsic Capacity ProMotion in PrimAry Care for The Frail Program (IMPACTFrail)
Effectiveness of a Customized Digital Platform to Increase Coordination of Care and Uptake of Evidence-based Practices: a Protocol for a Stepped-wedge Cluster Randomized Trial in Quebec
Evaluating the Feasibility of an Intensity-Adapted Pediatric Acute Myeloid Leukemia Treatment Guideline in Malawi
Choose to Move Replacement Ready: A Feasibility Trial of a Virtual Health-promoting Intervention for People Awaiting Total Hip or Knee Replacement Surgery
The CONNECT Program: Engaging Community Organizations in the Implementation and Evaluation of a Group Telehealth Mental Health Program for Older Canadians
Alleviating Loneliness in Older Adults Living in Poverty: A Multi-level Intervention
NCT07191236 enrolling by invitationnot on this mapstarted 2025, after this paper: background citation
Telemonitoring for High-risk Pregnancies in an International Context (PregnaDigit EU): a Hybrid Type 2 Study
Doula Link for Perinatal Mental Health - Trial
Community Pharmacies as Social Determinant of Health Navigators
Combining Social Network Strategies and Routine Substance Use Screening
STEM As I Am: A Culturally Relevant Media-enhanced Tool for Engaging Black Middle School Students and Their Families in STEM
Multicenter Mixed-Methods Pilot Study Evaluating a Personalized Care Management Model (GAP-421) for Chronic Pain in Primary Care Physiotherapy: Feasibility, Care Coordination, and Patient-Reported Outcomes
Survivorship Care in Patients With Hematologic Cancer Undergoing HSCT: A Feasibility Study on Quality of Life, Unmet Needs, and Caregivers Burden
OptiMAx: Incentivizing EPI Vaccination Via Distribution of SQ-LNS Nutritional Supplementation to Children From Age 6-11 Months Until 18 Months of Age in Rural Chad and Niger, With a Cost Effectiveness Analysis Protocol for a Research Study Nested in the OptiMA Research Study in Ngouri Health District, Lake Region, Chad and Mirriah Health District, Zinder Region, Niger
PrEP-LANA (Pre-exposure Prophylaxis- Long-acting Novel Antiviral Agent)
Peel Family Diabetes Prevention Program (Peel FDPP): Family-Centred Health and Wellness Coaching Pilot Randomized Controlled Trial
EmpowerHer: Protocol for a Multicentre Randomized Controlled Trial Evaluating a Hybrid Digital Exercise and Education Intervention for Breast Cancer Survivors Across Five European Countries
Choose to Move Replacement Ready: Implementation and Effectiveness of a Virtual Health-Promoting Intervention for People Awaiting Total Hip or Knee Replacement Surgery
A Community Mapping and Participatory Research Protocol for Expanding Access to Preventive Chemotherapy Among Mobile and Migrant Populations Through Social and Occupational Networks in Nigeria: MISSION Nigeria
CanCOG® - Cognitive Rehabilitation in Cancer: A Protocol for a Multicenter Pilot Randomized Controlled Trial With Non-central Nervous System Cancer Survivors
Who cites it
4,711 citing papers in PubMed, 11 syntheses or guidelines pooled it.
- Implementation of Total Body Photography for Skin Cancer Early Detection: A Systematic Review.International journal of dermatology · 2026Pooled it
- Effects of Digital Health Interventions in Chronic Musculoskeletal Pain: Systematic Review and Bayesian Network Meta-Analysis of Randomized Controlled Trials.Journal of medical Internet research · 2026Pooled it
- Oral Health Interventions for Culturally and Linguistically Diverse Children and Caregivers: A RE-AIM Systematic Review of Implementation Gaps.Community dentistry and oral epidemiology · 2026Pooled it
- Teach-Back in Clinical Communication: A Systematic Review and Meta-analysis.Journal of general internal medicine · 2026Pooled it
- Implementation science in care for older adults across healthcare settings: a scoping review.Archives of public health = Archives belges de sante publique · 2026Pooled it
- Psychosocial Interventions for Patients Undergoing Gastrointestinal Cancer Surgery: A Systematic Review.Annals of surgical oncology · 2026Pooled it
- Implementation outcomes of the WHO psychosocial intervention problem management plus in humanitarian settings: a systematic review.Epidemiology and psychiatric sciences · 2026Pooled it
- AI-powered risk prediction models for preventable maternal mortality in rural settings: a systematic review.BMC medical informatics and decision making · 2026Pooled it
- Effectiveness of Digital Health Interventions for Improving Antiretroviral Therapy Outcomes in People With HIV: Meta-Analysis and Trial Sequential Analysis of Randomized Controlled Trials.Journal of medical Internet research · 2026Pooled it
- A systematic review investigating policy design and implementation of US state and local policy to restrict the sale of flavored tobacco products.Nicotine & tobacco research : official journal of the Society for Research on Nicotine and Tobacco · 2026Pooled it
- Strengthening primary care facility management: a systematic review of management interventions, implementation strategies, and outcomes in six sub-Saharan African countries.BMC primary care · 2026Pooled it
- Implementing pragmatic case finding to address alcohol use in general practice: a mixed methods feasibility study.Scandinavian journal of primary health care · 2026Trial
- Estimating the Economic Value of Supported Online Parent-Led Cognitive Behavioral Therapy to Prevent Child Anxiety Problems: Economic Evaluation of the MYCATS Cluster Randomized Controlled Trial.Journal of medical Internet research · 2026Trial
- Multidimensional Poverty and Implementation Reach of Household Contact Tracing for Tuberculosis in South Africa: Analysis of a Randomized Trial.Clinical infectious diseases : an official publication of the Infectious Diseases Society of America · 2026Trial
- Assessing Fidelity to HIV Index Case Testing Protocols in Malawian Clinical Settings: Results From a Cluster Randomized Controlled Trial.Journal of the International AIDS Society · 2026Trial
- A Conversation Tool to Enhance Care for People With Type 2 Diabetes: The QBSafe Cluster Randomized Clinical Trial.JAMA network open · 2026Trial
- Flushing Strategies for Totally Implantable Venous Access Devices in Nurse-Led Cancer Care: Exploratory Randomized Clinical Trial.Nursing open · 2026Trial
- Effectiveness of structured lactation support and human donor milk banking in German NICUs: a stepped-wedge cluster-randomized trial.BMC medicine · 2026Trial
- A multi-site study of implementing a school-based health promotion intervention in Sweden - changes in readiness and implementation outcomes.BMC public health · 2026Trial
- Child and school staff perceptions and experiences of universal social and emotional learning curricula in context: A qualitative case study registered report examining 'Passport Skills for Life'.The British journal of educational psychology · 2026Trial
4,651 more citing papers are in PubMed but not listed here.
Corrections and comments
PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.
Authors and funding
8 authors.
Enola ProctorGeorge Warren Brown School of Social Work, Washington University in St. Louis, One Brookings Drive, St. Louis, MO 63130, USA. ekp@wustl.edu
Hiie Silmere
Ramesh Raghavan
Peter Hovmand
Greg Aarons
Alicia Bunger
Richard Griffey
Melissa Hensley
Funding
Washington University Institute of Clinical and Translational Sciences (UL1)UL1RR024992 · NCRR · WASHINGTON UNIVERSITY · PI EVANOFF, BRADLEY A · 2007 to 2011
$45.4MGWB MENTAL HEALTH SERVICE RESEARCH TRAININGT32MH019960 · NIMH · WASHINGTON UNIVERSITY · PI Leopoldo J Cabassa, Byron James Powell · 1995 to 2026
$11.1MOPERATIONS CORE (285-351)P30MH068579 · NIMH · WASHINGTON UNIVERSITY · PI MCMILLEN, J. CURTIS · 2004 to 2008
$7.0MNCRR NIH HHS UL1 RR024992NCRR NIH HHS UL1RR024992.NIMH NIH HHS P30 MH068579NIMH NIH HHS T32 MH019960
Abstract
An unresolved issue in the field of implementation research is how to conceptualize and evaluate successful implementation. This paper advances the concept of "implementation outcomes" distinct from service system and clinical treatment outcomes. This paper proposes a heuristic, working "taxonomy" of eight conceptually distinct implementation outcomes-acceptability, adoption, appropriateness, feasibility, fidelity, implementation cost, penetration, and sustainability-along with their nominal definitions. We propose a two-pronged agenda for research on implementation outcomes. Conceptualizing and measuring implementation outcomes will advance understanding of implementation processes, enhance efficiency in implementation research, and pave the way for studies of the comparative effectiveness of implementation strategies.
Indexed as
Diffusion of InnovationBiomedical ResearchHumansMental Health ServicesOutcome and Process Assessment, Health Care
Identifiers
What OpenQuestion holds
Textmetadata
LicenceCC BY-NC
Read underepoch 390
Registered trials
NCT03075085ClinicalTrials.gov
NCT03136211ClinicalTrials.gov
NCT03243396ClinicalTrials.gov
NCT03245788ClinicalTrials.gov
NCT03271242ClinicalTrials.gov
NCT03316547ClinicalTrials.gov
and 63 more above
Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.