Evidence map›Paper›PMID 41345743›Full record

ArticleImplementation science communications2025

Validation of the extended version of the Implementation Leadership Scale (ILS-X).

Mark G Ehrhart, Nathaniel J Williams, Marisa Sklar, Nallely R Vega, Alexandra Kandah, Gregory A Aarons

Abstract read
In one paragraph

Article in Implementation science communications, 2025. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Not yet cited in PubMed.

0numbers the graph read from it
0cells of the map it votes in
0citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

0 citing papers in PubMed.

No citing paper in PubMed yet.

4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

6 authors.

Mark G EhrhartDepartment of Psychology, University of Central Florida, 4111 Pictor Lane, Orlando, FL, 32816-1390, USA.
Nathaniel J WilliamsInstitute for the Study of Behavioral Health and Addiction, Boise State University, 1910 University Drive, Education Suite 717, Boise, ID, 83725-1940, USA.
Marisa SklarDepartment of Psychiatry, University of California, San Diego, 9500 Gilman Drive (0812), La Jolla, CA, 92093-0812, USA.
Nallely R VegaInstitute for the Study of Behavioral Health and Addiction, Boise State University, 1910 University Drive, Education Suite 717, Boise, ID, 83725-1940, USA.
Alexandra KandahDepartment of Psychology, University of Central Florida, 4111 Pictor Lane, Orlando, FL, 32816-1390, USA.
Gregory A AaronsDepartment of Psychiatry, University of California, San Diego, 9500 Gilman Drive (0812), La Jolla, CA, 92093-0812, USA. gaarons@health.ucsd.edu.ORCID http://orcid.org/0000-0001-8969-5002

Funding

Statewide System and Organizational Strategy for Evidence-Based Practice Implementation and Sustainment in Substance Use Disorder TreatmentR01DA049891 · NIDA · UNIVERSITY OF CALIFORNIA, SAN DIEGO · PI AARONS, GREGORY · 2020 to 2024
$3.6M
Randomized trial of a leadership and organizational change strategy to improve the implementation and sustainment of digital measurement-based care in youth mental health servicesR01MH119127 · NIMH · BOISE STATE UNIVERSITY · PI WILLIAMS, NATHANIEL J. · 2019 to 2022
$2.8M
NIDA NIH HHS R01 DA049891NIDA NIH HHS R01DA049891NIMH NIH HHS R01MH119127
6 · The paper itself

Abstract

backgroundImplementation science has made significant advances in our understanding of organizational factors that impact the implementation process. Critical to those advances has been the development of measures of key implementation-focused organizational constructs, such as implementation leadership. The Implementation Leadership Scale (ILS) was developed to capture leadership behavior identified as critical to implementation effectiveness. Recent research in education has identified additional dimensions of implementation leadership that extend our understanding of how leaders contribute to the successful implementation and sustainment of new practices. The goal of this paper is to validate the extended version of the Implementation Leadership Scale, or the ILS-X, in behavioral health settings.

methodThis paper utilized baseline data from two large implementation trials conducted in behavioral health settings that collected survey data on the ILS-X measure from 389 providers across 68 behavioral health clinics. The ILS-X is a pragmatic measure with 21 items assessing seven dimensions of implementation leadership (proactive, knowledgeable, supportive, perseverant, communication, vision/mission, and available). Analyses assessed internal consistency reliability, interrater reliability and agreement, factor structure, and construct validity evidence for scores on the measure.

resultsThe ILS-X performed well across all criteria. A second-order confirmatory factor model fit the data well and had high factor loadings across all dimensions. Correlations with other clinic-level measures (e.g., transformational leadership, organizational climate, aggregate job satisfaction, clinic characteristics) were consistent with theory-guided expectations. Internal consistency reliability and aggregation indices supported future use of the measure.

conclusionThe ILS-X allows implementation researchers and practitioners to reliably assess a more comprehensive array of implementation leadership behaviors that builds on the original ILS measure. The ILS-X will be valuable for targeting an expanded range of behaviors for identifying areas of leadership strength and improvement during implementation efforts.

Indexed as

Behavioral health servicesConfirmatory factory analysisEvidence-based practiceImplementationImplementation leadershipLeadershipMeasurement

Identifiers

PMID41345743
PMCPMC12676754

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.