Evidence map›Paper›PMID 29310673›Full record

ArticleImplementation science : IS2018

Assessing organizational implementation context in the education sector: confirmatory factor analysis of measures of implementation leadership, climate, and citizenship.

Aaron R Lyon, Clayton R Cook, Eric C Brown, Jill Locke, Chayna Davis, Mark Ehrhart, Gregory A Aarons

Open access · goldAbstract read
PubMed Full text at PMC Publisher
In one paragraph

Article in Implementation science : IS, 2018. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 82 papers, 2 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
82citing papers in PubMed, 2 pooled it
29.0field-weighted citation impact, top 1% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

82 citing papers in PubMed, 2 syntheses or guidelines pooled it, 209 citations in OpenAlex.

  1. Pooled it
  2. Pooled it
  3. Trial
  4. Trial
  5. Trial
  6. Trial
  7. Trial
  8. Trial
  9. Review
  10. Article
  11. Article
  12. Article
  13. Article
  14. Article
  15. Article
  16. Article
  17. Observational
  18. Article
  19. Article
  20. Article

22 more citing papers are in PubMed but not listed here.

4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

7 authors at 5 institutions in 2 countries.

Aaron R LyonUniversity of Washington, 6200 NE 74th Street, Suite 100, Seattle, WA, 98115, USA. lyona@uw.edu.
Clayton R CookUniversity of Minnesota, 250 Education Sciences Bldg, 56 East River Road, Minneapolis, MN, 55455, USA.
Eric C BrownDepartment of Public Health Sciences, Miller School of Medicine, University of Miami, 1120 NW 14th Street, Office 104, Miami, FL, 33136, USA.
Jill LockeUniversity of Washington, 6200 NE 74th Street, Suite 100, Seattle, WA, 98115, USA.
Chayna DavisUniversity of Washington, 6200 NE 74th Street, Suite 100, Seattle, WA, 98115, USA.
Mark EhrhartUniversity of Central Florida, 4111 Pictor Lane, Orlando, FL, 32816-1390, USA.
Gregory A AaronsUniversity of California San Diego, 9500 Gilman Drive (0812), La Jolla, CA, 92093, USA.
University of Washington · USChild, Adolescent and Family Mental Health · CAUniversity of Central Florida · USUniversity of Miami · USUniversity of Minnesota · US

Funding

Implementation of a Measurement Feedback System in School Mental HealthK08MH095939 · NIMH · UNIVERSITY OF WASHINGTON · PI LYON, AARON ROBERT · 2012 to 2016
$787k
Staff and School Factors Affecting Implementation of ASD Interventions in SchoolsK01MH100199 · NIMH · UNIVERSITY OF WASHINGTON · PI LOCKE, JILL J · 2014 to 2017
$698k
Institute of Education Sciences R305A160114NIMH NIH HHS K01 MH100199NIMH NIH HHS K01MH100199NIMH NIH HHS K08 MH095939NIMH NIH HHS K08MH095939
6 · The paper itself

Abstract

backgroundA substantial literature has established the role of the inner organizational setting on the implementation of evidence-based practices in community contexts, but very little of this research has been extended to the education sector, one of the most common settings for the delivery of mental and behavioral health services to children and adolescents. The current study examined the factor structure, psychometric properties, and interrelations of an adapted set of pragmatic organizational instruments measuring key aspects of the organizational implementation context in schools: (1) strategic implementation leadership, (2) strategic implementation climate, and (3) implementation citizenship behavior.

methodThe Implementation Leadership Scale (ILS), Implementation Climate Scale (ICS), and Implementation Citizenship Behavior Scale (ICBS) were adapted by a research team that included the original scale authors and experts in the implementation of evidence-based practices in schools. These instruments were then administered to a geographically representative sample (n = 196) of school-based mental/behavioral health consultants to assess the reliability and structural validity via a series of confirmatory factor analyses.

resultsOverall, the original factor structures for the ILS, ICS, and ICBS were confirmed in the current sample. The one exception was poor functioning of the Rewards subscale of the ICS, which was removed in the final ICS model. Correlations among the revised measures, evaluated as part of an overarching model of the organizational implementation context, indicated both unique and shared variance.

conclusionsThe current analyses suggest strong applicability of the revised instruments to implementation of evidence-based mental and behavioral practices in the education sector. The one poorly functioning subscale (Rewards on the ICS) was attributed to typical educational policies that do not allow for individual financial incentives to personnel. Potential directions for future expansion, revision, and application of the instruments in schools are discussed.

Indexed as

ClimateLeadershipOrganizational CultureOrganizational InnovationAdultChildEvidence-Based PracticeFactor Analysis, StatisticalFemaleHumansMaleReproducibility of ResultsYoung AdultEducationImplementation citizenshipImplementation climateImplementation leadershipReliabilitySchoolsStructural validity

Identifiers

PMID29310673
PMCPMC5759223
OpenAlexW2783384668

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.