Evidence map›Paper›PMID 38902763›Full record

ArticleImplementation science : IS2024

Integrated Measure of PRogram Element SuStainability in Childcare Settings (IMPRESS-C): development and psychometric evaluation of a measure of sustainability determinants in the early childhood education and care setting.

Adam Shoesmith, Nicole Nathan, Melanie Lum, Serene Yoong, Erin Nolan, Luke Wolfenden, Rachel C Shelton, Brittany Cooper, Cassandra Lane, Alice Grady and 5 more

Abstract read
In one paragraph

Article in Implementation science : IS, 2024. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 4 papers.

0numbers the graph read from it
0cells of the map it votes in
4citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

4 citing papers in PubMed.

  1. Trial
  2. Article
  3. Article
  4. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

15 authors.

Adam ShoesmithSchool of Medicine and Public Health, University of Newcastle, Newcastle, NSW, 2308, Australia. Adam.Shoesmith@health.nsw.gov.au.ORCID 0000-0002-3105-8833
Nicole NathanSchool of Medicine and Public Health, University of Newcastle, Newcastle, NSW, 2308, Australia.
Melanie LumSchool of Medicine and Public Health, University of Newcastle, Newcastle, NSW, 2308, Australia.
Serene YoongSchool of Medicine and Public Health, University of Newcastle, Newcastle, NSW, 2308, Australia.
Erin NolanSchool of Medicine and Public Health, University of Newcastle, Newcastle, NSW, 2308, Australia.
Luke WolfendenSchool of Medicine and Public Health, University of Newcastle, Newcastle, NSW, 2308, Australia.
Rachel C SheltonDepartment of Sociomedical Sciences, Mailman School of Public Health, Columbia University, New York, NY, 10032, USA.
Brittany CooperDepartment of Human Development, Washington State University, Pullman, WA, 99164, USA.
Cassandra LaneSchool of Medicine and Public Health, University of Newcastle, Newcastle, NSW, 2308, Australia.
Alice GradySchool of Medicine and Public Health, University of Newcastle, Newcastle, NSW, 2308, Australia.
Noor ImadHunter New England Population Health, Hunter New England Local Health District, Newcastle, NSW, 2287, Australia.
Edward Riley-GibsonSchool of Medicine and Public Health, University of Newcastle, Newcastle, NSW, 2308, Australia.
Nicole McCarthySchool of Medicine and Public Health, University of Newcastle, Newcastle, NSW, 2308, Australia.
Nicole PearsonSchool of Medicine and Public Health, University of Newcastle, Newcastle, NSW, 2308, Australia.
Alix HallSchool of Medicine and Public Health, University of Newcastle, Newcastle, NSW, 2308, Australia.

Funding

American Cancer Society RSG-17-156-01-CPPBAustralia Research Council Discovery Early Career Research Awards DE170100382National Health and Medical Research Council APP1194785National Health and Medical Research Council APP1197022
6 · The paper itself

Abstract

backgroundThere is a need for valid and reliable measures of determinants of sustainability of public health interventions in early childhood education and care (ECEC) settings. This study aimed to develop and evaluate the psychometric and pragmatic properties of such a measure - the Integrated Measure of PRogram Element SuStainability in Childcare Settings (IMPRESS-C).

methodsWe undertook a two-phase process guided by the COnsensus-based Standards for the selection of health status Measurement INstruments checklist (COSMIN) and Psychometric and Pragmatic Evidence Rating Scale (PAPERS). Phase 1 involved measure development; i.e., determining items and scales through an iterative process and assessment of face and content validity. Phase 2 involved the evaluation of psychometric and pragmatic properties. The 29-item measure completed by service executives (directors and nominated supervisors) was embedded in a larger survey from a national sample of Australian ECEC services assessing their implementation of nutrition and physical activity programs. Structural validity, concurrent validity, known groups validity, internal consistency, floor and ceiling effects, norms, and pragmatic qualities of the measure were assessed according to the PAPERS criteria.

resultsThe final measure contained 26 items, with respondents reporting how strongly they agreed or disagreed on a five-point Likert scale. Phase 1 assessments confirmed the relevance, and face and content validity of the scale. In Phase 2, we obtained 482 completed surveys, of which 84% (n = 405) completed the entire measure across 405 ECEC settings (one executive per service). Three of the four fit indices for the confirmatory factor analysis met the pre-specified criteria (SRMR = 0.056, CFI = 0.993, RMSEA = 0.067) indicating 'good' structural validity. The IMPRESS-C illustrated: 'good' internal consistency, with Cronbach's alpha values from 0.53 to 0.92; 'emerging' concurrent validity; 'poor' known groups validity; 'good' norms; and 'good' overall pragmatic qualities (cost, readability, length, and assessor burden).

conclusionsThe IMPRESS-C possesses strong psychometric and pragmatic qualities for assessing service executive-level perceptions of determinants influencing sustainment of public health interventions within ECEC settings. To achieve a full range of perspectives in this setting, future work should be directed to also develop and test measures of sustainability determinants at the implementer level (e.g., among individual educators and staff).

Indexed as

Child CareEducationPsychometricsChildCross-Sectional StudiesHumansSurveys and QuestionnairesDevelopmentEarly childhood education and careMeasurementReliabilitySustainabilitySustainmentValidity

Identifiers

PMID38902763
PMCPMC11188265

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.