Evidence map›Paper›PMID 36441362›Full record

ArticlePrevention science : the official journal of the Society for Prevention Research2023

Informing Harmonization Decisions in Integrative Data Analysis: Exploring the Measurement Multiverse.

Veronica T Cole, Andrea M Hussong, Nisha C Gottfredson, Daniel J Bauer, Patrick J Curran

Abstract read
PubMed Publisher
In one paragraph

Article in Prevention science : the official journal of the Society for Prevention Research, 2023. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 16 papers.

0numbers the graph read from it
0cells of the map it votes in
16citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

16 citing papers in PubMed.

  1. Trial
  2. Article
  3. A Taxonomy of Data Synthesis.Personality & social psychology bulletin · 2026
    Article
  4. Article
  5. Article
  6. Observational
  7. Article
  8. Article
  9. Article
  10. Positioning adolescence in the developmental timeline.Journal of research on adolescence : the official journal of the Society for Research on Adolescence · 2024
    Article
  11. The Impact of Sparse Datasets When Harmonizing Data from Studies with Different Measures of the Same Construct.Prevention science : the official journal of the Society for Prevention Research · 2024
    Article
  12. Retrospective Psychometrics and Effect Heterogeneity in Integrated Data Analysis: Commentary on the Special Issue.Prevention science : the official journal of the Society for Prevention Research · 2023
    Article
  13. Advancing Intervention and Prevention Research for Behavioral Health Problems Through Data Synthesis.Prevention science : the official journal of the Society for Prevention Research · 2023
    Article
  14. Article
  15. Article
  16. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

5 authors.

Veronica T ColeDepartment of Psychology, Wake Forest University, 1834 Wake Forest Road, Winston-Salem, NC, 27109, USA. colev@wfu.edu.ORCID 0000-0002-1139-1620
Andrea M HussongDepartment of Psychology and Neuroscience, University of North Carolina at Chapel Hill, Chapel Hill, NC, USA.
Nisha C GottfredsonDepartment of Health Behavior, Gillings School of Global Public Health, University of North Carolina at Chapel Hill, Chapel Hill, NC, USA.
Daniel J BauerDepartment of Psychology and Neuroscience, University of North Carolina at Chapel Hill, Chapel Hill, NC, USA.
Patrick J CurranDepartment of Psychology and Neuroscience, University of North Carolina at Chapel Hill, Chapel Hill, NC, USA.

Funding

Harmonizing substance use and disorder measures to facilitate multistudy analysesR01DA034636 · NIDA · UNIV OF NORTH CAROLINA CHAPEL HILL · PI BAUER, DANIEL J · 2013 to 2017
$2.9M
NIDA NIH HHS R01 DA034636
6 · The paper itself

Abstract

Combining datasets in an integrative data analysis (IDA) requires researchers to make a number of decisions about how best to harmonize item responses across datasets. This entails two sets of steps: logical harmonization, which involves combining items which appear similar across datasets, and analytic harmonization, which involves using psychometric models to find and account for cross-study differences in measurement. Embedded in logical and analytic harmonization are many decisions, from deciding whether items can be combined prima facie to how best to find covariate effects on specific items. Researchers may not have specific hypotheses about these decisions, and each individual choice may seem arbitrary, but the cumulative effects of these decisions are unknown. In the current study, we conducted an IDA of the relationship between alcohol use and delinquency using three datasets (total N = 2245). For analytic harmonization, we used moderated nonlinear factor analysis (MNLFA) to generate factor scores for delinquency. We conducted both logical and analytic harmonization 72 times, each time making a different set of decisions. We assessed the cumulative influence of these decisions on MNLFA parameter estimates, factor scores, and estimates of the relationship between delinquency and alcohol use. There were differences across paths in MNLFA parameter estimates, but fewer differences in estimates of factor scores and regression parameters linking delinquency to alcohol use. These results suggest that factor scores may be relatively robust to subtly different decisions in data harmonization, and measurement model parameters are less so.

Indexed as

Alcohol DrinkingData AnalysisFactor Analysis, StatisticalHumansPsychometricsData harmonizationLatent variable modelsMultiverse analysis

Identifiers

What OpenQuestion holds

Textmetadata
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.