Evidence map›Paper›PMID 38030923›Full record

ArticleBehavior research methods2024

Does strict invariance matter? Valid group mean comparisons with ordered-categorical items.

Winnie Wing-Yee Tse, Mark H C Lai, Yichi Zhang

Abstract read
In one paragraph

Article in Behavior research methods, 2024. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 11 papers.

0numbers the graph read from it
0cells of the map it votes in
11citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

11 citing papers in PubMed.

  1. Article
  2. Article
  3. Article
  4. Article
  5. Article
  6. Article
  7. Article
  8. Article
  9. Article
  10. Article
  11. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

3 authors.

Winnie Wing-Yee TseDepartment of Psychology, University of Southern California, 3620 S McClintock Ave, Los Angeles, CA, 90089, USA.ORCID http://orcid.org/0000-0001-5175-6754
Mark H C LaiDepartment of Psychology, University of Southern California, 3620 S McClintock Ave, Los Angeles, CA, 90089, USA. hokchiol@usc.edu.ORCID http://orcid.org/0000-0002-9196-7406
Yichi ZhangDepartment of Psychology, University of Southern California, 3620 S McClintock Ave, Los Angeles, CA, 90089, USA.ORCID http://orcid.org/0000-0002-4112-2106

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

Measurement invariance (MI) of a psychometric scale is a prerequisite for valid group comparisons of the measured construct. While the invariance of loadings and intercepts (i.e., scalar invariance) supports comparisons of factor means and observed means with continuous items, a general belief is that the same holds with ordered-categorical (i.e., ordered-polytomous and dichotomous) items. However, as this paper shows, this belief is only partially true-factor mean comparison is permissible in the correctly specified scalar invariance model with ordered-polytomous items but not with dichotomous items. Furthermore, rather than scalar invariance, full strict invariance-invariance of loadings, thresholds, intercepts, and unique factor variances in all items-is needed when comparing observed means with both ordered-polytomous and dichotomous items. In a Monte Carlo simulation study, we found that unique factor noninvariance led to biased estimations and inferences (e.g., with inflated type I error rates of 19.52%) of (a) the observed mean difference for both ordered-polytomous and dichotomous items and (b) the factor mean difference for dichotomous items in the scalar invariance model. We provide a tutorial on invariance testing with ordered-categorical items as well as suggestions on mean comparisons when strict invariance is violated. In general, we recommend testing strict invariance prior to comparing observed means with ordered-categorical items and adjusting for partial invariance to compare factor means if strict invariance fails.

Indexed as

Monte Carlo MethodPsychometricsComputer SimulationData Interpretation, StatisticalFactor Analysis, StatisticalHumansModels, Statistical

Identifiers

PMID38030923
PMCPMC11133089

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.