Evidence map›Paper›PMID 29587804›Full record

ArticleImplementation science : IS2018

Developing measures to assess constructs from the Inner Setting domain of the Consolidated Framework for Implementation Research.

Maria E Fernandez, Timothy J Walker, Bryan J Weiner, William A Calo, Shuting Liang, Betsy Risendal, Daniela B Friedman, Shin Ping Tu, Rebecca S Williams, Sara Jacobs and 2 more

Registry-linked trialAbstract read
In one paragraph

Article in Implementation science : IS, 2018. The graph could read no effect estimate from its abstract, so it casts no vote on the map. It is linked to trial NCT03938103 (A Hybrid Effectiveness-implementation Trial of Go NAPSACC), which is not on this map. Cited by 145 papers, 2 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
145citing papers in PubMed, 2 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

NCT03938103 nacompletednot on this mapstarted 2019, after this paper: background citation

A Hybrid Effectiveness-implementation Trial of Go NAPSACC: A Childcare-based Obesity Prevention Program

TypeinterventionalSponsorUniversity of North Carolina, Chapel HillRan2019 to 2022Enrolled364ConditionsObesityArmsEnhanced Go NAPSACC, Basic Go NAPSACC
3 · Its place in the literature

Who cites it

145 citing papers in PubMed, 2 syntheses or guidelines pooled it.

  1. Pooled it
  2. Pooled it
  3. Trial
  4. Trial
  5. Trial
  6. Trial
  7. Trial
  8. Trial
  9. Implementation of Coach McLungsBMC medical informatics and decision making · 2022
    Trial
  10. Trial
  11. Trial
  12. Article
  13. Article
  14. Article
  15. Article
  16. Hospital-Level Variation in Antenatal Corticosteroids for Late Preterm Births.medRxiv : the preprint server for health sciences · 2026
    Article
  17. Article
  18. Article
  19. Article
  20. Article

85 more citing papers are in PubMed but not listed here.

4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

12 authors.

Maria E FernandezUniversity of Texas Health Science Center at Houston, Center for Health Promotion and Prevention Research, School of Public Health, 7000 Fannin St, Houston, TX, 77030, USA. Maria.E.Fernandez@uth.tmc.edu.
Timothy J WalkerUniversity of Texas Health Science Center at Houston, Center for Health Promotion and Prevention Research, School of Public Health, 7000 Fannin St, Houston, TX, 77030, USA.
Bryan J WeinerDepartment of Global Health, University of Washington, Box 357965, 1510 San Juan Road, Seattle, WA, 98195, USA.
William A CaloDepartment of Public Health Sciences, Penn State College of Medicine, Mail Code CH69 | 500 University Drive, Hershey, PA, 17033, USA.
Shuting LiangEmory Prevention Research Center, Department of Behavioral Sciences and Health Education, Rollins School of Public Health, Emory University, 1518 Clifton Road NE, Atlanta, GA, 30033, USA.
Betsy RisendalDepartment of Community and Behavioral Health, Colorado School of Public Health, University of Colorado Comprehensive Cancer Center, 13001 E. 17th Place, MSF538, Aurora, CO, 80045, USA.
Daniela B FriedmanDepartment of Health Promotion, Education, and Behavior and the Statewide Cancer Prevention and Control Program, Arnold School of Public Health, University of South Carolina, 915 Greene Street, Columbia, SC, 29208, USA.
Shin Ping TuDepartment of Internal Medicine, University of California Davis, Suite 2400 , 4150 V Street, Sacramento, CA, 95817, USA.
Rebecca S WilliamsCenter for Health Promotion and Disease Prevention, Lineberger Comprehensive Cancer Center, University of North Carolina at Chapel Hill, CB 7424, Chapel Hill, NC, 27599, USA.
Sara JacobsPublic Health Research Division, RTI International, 3040 East Cornwallis Road, Research Triangle Park, Durham, NC, 27709-2194, USA.
Alison K HerrmannUCLA Kaiser Permanente Center for Health Equity, Fielding School of Public Health and Jonsson Comprehensive Cancer Center, 650 Charles E. Young Dr. S., A2-125 CHS, Box 690015, Los Angeles, CA, 90095-6900, USA.
Michelle C KeglerEmory Prevention Research Center, Department of Behavioral Sciences and Health Education, Rollins School of Public Health, Emory University, 1518 Clifton Road NE, Atlanta, GA, 30033, USA.

Funding

BEHAVIORAL SCIENCE EDUCATION--CANCER PREVENTION/CONTROLR25CA057712 · NCI · UNIVERSITY OF TEXAS HLTH SCI CTR HOUSTON · PI MULLEN, PATRICIA DOLAN · 1992 to 2017
$8.6M
HEALTH PROMOTION AND DISEASE PREVENTION RESEARCH CENTERS - CENTER CATEGORY 1U48DP001949 · DP · UNIVERSITY OF TEXAS HLTH SCI CTR HOUSTON · PI TORTOLERO, SUSAN · 2009 to 2013
$7.9M
UCLA/RAND PREVENTION RESEARCH CENTERU48DP001934 · DP · UNIVERSITY OF CALIFORNIA LOS ANGELES · PI BASTANI, ROSHAN · 2009 to 2013
$5.9M
Cancer Training GrantR25CA116339 · NCI · UNIV OF NORTH CAROLINA CHAPEL HILL · PI BASCH, ETHAN M., REEVE, BRYCE B · 2008 to 2017
$4.0M
Cancer Care Quality Training ProgramT32CA116339 · NCI · UNIV OF NORTH CAROLINA CHAPEL HILL · PI ETHAN M. BASCH, Stephanie Brooke Wheeler · 2018 to 2026
$3.0M
Cancer Control Dissemination to Asian AmericansR01CA124397 · NCI · UNIVERSITY OF WASHINGTON · PI TU, SHIN-PING · 2007 to 2011
$998k
Dissemination through Community Health Centers Serving Diverse PopulationsR21CA136460 · NCI · UNIVERSITY OF WASHINGTON · PI TU, SHIN-PING · 2009 to 2010
$318k
ACL HHS U48DP001944CDC HHS U48DP0010909CDC HHS U48DP001903CDC HHS U48DP001911CDC HHS U48DP001924CDC HHS U48DP001934CDC HHS U48DP001936CDC HHS U48DP001938CDC HHS U48DP001944CDC HHS U48DP001946CDC HHS U48DP001949NCCDPHP CDC HHS U48 DP001903NCCDPHP CDC HHS U48 DP001911NCCDPHP CDC HHS U48 DP001924NCCDPHP CDC HHS U48 DP001934NCCDPHP CDC HHS U48 DP001936NCCDPHP CDC HHS U48 DP001938NCCDPHP CDC HHS U48 DP001946NCCDPHP CDC HHS U48 DP001949NCI NIH HHS R01 CA124397NCI NIH HHS R01CA124397NCI NIH HHS R21 CA136460NCI NIH HHS R21CA136460NCI NIH HHS R25 CA057712NCI NIH HHS R25CA057712NCI NIH HHS R25 CA116339NCI NIH HHS R25CA116339NCI NIH HHS T32 CA116339
6 · The paper itself

Abstract

backgroundScientists and practitioners alike need reliable, valid measures of contextual factors that influence implementation. Yet, few existing measures demonstrate reliability or validity. To meet this need, we developed and assessed the psychometric properties of measures of several constructs within the Inner Setting domain of the Consolidated Framework for Implementation Research (CFIR).

methodsWe searched the literature for existing measures for the 7 Inner Setting domain constructs (Culture Overall, Culture Stress, Culture Effort, Implementation Climate, Learning Climate, Leadership Engagement, and Available Resources). We adapted items for the healthcare context, pilot-tested the adapted measures in 4 Federally Qualified Health Centers (FQHCs), and implemented the revised measures in 78 FQHCs in the 7 states (N = 327 respondents) with a focus on colorectal cancer (CRC) screening practices. To psychometrically assess our measures, we conducted confirmatory factor analysis models (CFA; structural validity), assessed inter-item consistency (reliability), computed scale correlations (discriminant validity), and calculated inter-rater reliability and agreement (organization-level construct reliability and validity).

resultsCFAs for most constructs exhibited good model fit (CFI > 0.90, TLI > 0.90, SRMR < 0.08, RMSEA < 0.08), with almost all factor loadings exceeding 0.40. Scale reliabilities ranged from good (0.7 ≤ α < 0.9) to excellent (α ≥ 0.9). Scale correlations fell below 0.90, indicating discriminant validity. Inter-rater reliability and agreement were sufficiently high to justify measuring constructs at the clinic-level.

conclusionsOur findings provide psychometric evidence in support of the CFIR Inner Setting measures. Our findings also suggest the Inner Setting measures from individuals can be aggregated to represent the clinic-level. Measurement of the Inner Setting constructs can be useful in better understanding and predicting implementation in FQHCs and can be used to identify targets of strategies to accelerate and enhance implementation efforts in FQHCs.

Indexed as

Implementation ScienceDelivery of Health CareFactor Analysis, StatisticalFemaleHealth Plan ImplementationHumansOutcome Assessment, Health CarePsychometricsReproducibility of ResultsResearchCFIRColorectal cancer screening implementationConsolidated Framework for Implementation ResearchImplementation scienceInner SettingMeasurement of implementation

Identifiers

PMID29587804
PMCPMC5870186

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.