Evidence map›Paper›PMID 28434055›Full record

ArticlePrevention science : the official journal of the Society for Prevention Research2018

Addressing Methodologic Challenges and Minimizing Threats to Validity in Synthesizing Findings from Individual-Level Data Across Longitudinal Randomized Trials.

Ahnalee Brincks, Samantha Montag, George W Howe, Shi Huang, Juned Siddique, Soyeon Ahn, Irwin N Sandler, Hilda Pantin, C Hendricks Brown

Abstract read
In one paragraph

Article in Prevention science : the official journal of the Society for Prevention Research, 2018. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 33 papers, 4 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
33citing papers in PubMed, 4 pooled it
2.8field-weighted citation impact, top 10% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

33 citing papers in PubMed, 4 syntheses or guidelines pooled it, 34 citations in OpenAlex.

  1. Pooled it
  2. Addressing Systematic Missing Data in the Context of Causally Interpretable Meta-analysis.Prevention science : the official journal of the Society for Prevention Research · 2023
    Pooled it
  3. Pooled it
  4. Pooled it
  5. Trial
  6. Article
  7. Article
  8. Observational
  9. Article
  10. Article
  11. Article
  12. Article
  13. Article
  14. Retrospective Psychometrics and Effect Heterogeneity in Integrated Data Analysis: Commentary on the Special Issue.Prevention science : the official journal of the Society for Prevention Research · 2023
    Article
  15. Article
  16. Article
  17. Article
  18. Article
  19. Accounting for Context in Randomized Trials after Assignment.Prevention science : the official journal of the Society for Prevention Research · 2022
    Article
  20. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

9 authors at 6 institutions in 1 country.

Ahnalee BrincksDepartment of Epidemiology and Biostatistics, College of Human Medicine, Michigan State University, East Lansing, MI, USA.
Samantha MontagDepartment of Psychiatry and Behavioral Sciences, Feinberg School of Medicine, Northwestern University, 750 N. Lake Shore Dr, 10th Floor, Chicago, IL, 60611, USA.
George W HoweDepartment of Psychology, George Washington University, Washington, DC, USA.
Shi HuangDepartment of Biostatistics, Vanderbilt University, Nashville, TN, USA.
Juned SiddiqueDepartment of Psychiatry and Behavioral Sciences, Feinberg School of Medicine, Northwestern University, 750 N. Lake Shore Dr, 10th Floor, Chicago, IL, 60611, USA.
Soyeon AhnSchool of Education and Human Development, University of Miami, Miami, FL, USA.
Irwin N SandlerDepartment of Psychology, Arizona State University, Tempe, AZ, USA.
Hilda PantinDepartment of Public Health Sciences, Miller School of Medicine, University of Miami, Miami, FL, USA.
C Hendricks BrownDepartment of Psychiatry and Behavioral Sciences, Feinberg School of Medicine, Northwestern University, 750 N. Lake Shore Dr, 10th Floor, Chicago, IL, 60611, USA. hendricks.brown@northwestern.edu.ORCID 0000-0002-0294-2419
Northwestern University · USUniversity of Miami · USArizona State University · USGeorge Washington University · USMichigan State University · USVanderbilt University · US

Funding

Miami Clinical and Translational Science InstituteUL1TR000460 · NCATS · UNIVERSITY OF MIAMI SCHOOL OF MEDICINE · PI SACCO, RALPH L. · 2012 to 2016
$16.9M
STATISTICAL METHODS FOR MENTAL HEALTH PREVENTIVE TRIALSR01MH040859 · NIMH · UNIVERSITY OF SOUTH FLORIDA · PI BROWN, C. HENDRICKS · 1986 to 2014
$7.5M
ASU Prevention Research Center for Families in StressP30MH068685 · NIMH · ARIZONA STATE UNIVERSITY-TEMPE CAMPUS · PI SANDLER, IRWIN N. · 2005 to 2010
$7.0M
Preventive Intervention for Mexican American AdolescentsR01MH064707 · NIMH · ARIZONA STATE UNIVERSITY-TEMPE CAMPUS · PI GONZALES, NANCY A. · 2001 to 2011
$6.8M
Understanding and Preventing Early Adult Drug AbuseR01DA007031 · NIDA · UNIVERSITY OF OREGON · PI LEMERY-CHALFANT, KATHRYN · 1991 to 2015
$6.2M
Impact of the Family Bereavement Program Fifteen Years LaterR01MH049155 · NIMH · ARIZONA STATE UNIVERSITY-TEMPE CAMPUS · PI AYERS, TIM S, SANDLER, IRWIN N. · 1994 to 2014
$6.1M
Prevention of Depression in At-Risk AdolescentsR01MH064503 · NIMH · UNIVERSITY OF PITTSBURGH AT PITTSBURGH · PI BRENT, DAVID A. · 2003 to 2012
$3.9M
Families Preventing HIV in Hispanic AdolescentsR01MH063042 · NIMH · UNIVERSITY OF MIAMI SCHOOL OF MEDICINE · PI SZAPOCZNIK, JOSE · 2000 to 2004
$3.3M
A Family Intervention for Adolescent Problem BehaviorR01DA018374 · NIDA · UNIVERSITY OF OREGON · PI STORMSHAK, ELIZABETH A · 2005 to 2009
$3.2M
Prevention of Depression in At-Risk-AdolescentsR01MH064735 · NIMH · VANDERBILT UNIVERSITY · PI GARBER, JUDY · 2003 to 2012
$3.2M
PREVENTION OF DEPRESSION IN SCHOOL CHILDRENR01MH052270 · NIMH · UNIVERSITY OF PENNSYLVANIA · PI SELIGMAN, MARTIN E · 1996 to 2006
$3.0M
Preventing Drug Use and HIV in Hispanic AdolescentsR01DA017462 · NIDA · UNIVERSITY OF MIAMI SCHOOL OF MEDICINE · PI PANTIN, HILDA MARIE · 2003 to 2007
$2.8M
National Alliance for Research on Schizophrenia and Depression Young Investigator GrantNCATS NIH HHS UL1 TR000460NCHHSTP CDC HHS U01 PS000671NCI NIH HHS K07 CA154862NHLBI NIH HHS R01 HL127491NIDA NIH HHS R01-DA007029NIDA NIH HHS R01 DA007031NIDA NIH HHS R01 DA017462NIDA NIH HHS R01 DA018374NIDA NIH HHS R01 DA025894NIDA NIH HHS R01-DA13773NIMH NIH HHS K08 MH072918NIMH NIH HHS K23 MH071320NIMH NIH HHS P30 MH068685NIMH NIH HHS R01 MH040859NIMH NIH HHS R01-MH048696NIMH NIH HHS R01 MH049155NIMH NIH HHS R01 MH052270NIMH NIH HHS R01 MH063042NIMH NIH HHS R01 MH064503NIMH NIH HHS R01 MH064707NIMH NIH HHS R01 MH064717NIMH NIH HHS R01 MH064735NIMH NIH HHS R03-MH048118William T. Grant Foundation 961730
6 · The paper itself

Abstract

Integrative Data Analysis (IDA) encompasses a collection of methods for data synthesis that pools participant-level data across multiple studies. Compared with single-study analyses, IDA provides larger sample sizes, better representation of participant characteristics, and often increased statistical power. Many of the methods currently available for IDA have focused on examining developmental changes using longitudinal observational studies employing different measures across time and study. However, IDA can also be useful in synthesizing across multiple randomized clinical trials to improve our understanding of the comprehensive effectiveness of interventions, as well as mediators and moderators of those effects. The pooling of data from randomized clinical trials presents a number of methodological challenges, and we discuss ways to examine potential threats to internal and external validity. Using as an illustration a synthesis of 19 randomized clinical trials on the prevention of adolescent depression, we articulate IDA methods that can be used to minimize threats to internal validity, including (1) heterogeneity in the outcome measures across trials, (2) heterogeneity in the follow-up assessments across trials, (3) heterogeneity in the sample characteristics across trials, (4) heterogeneity in the comparison conditions across trials, and (5) heterogeneity in the impact trajectories. We also demonstrate a technique for minimizing threats to external validity in synthesis analysis that may result from non-availability of some trial datasets. The proposed methods rely heavily on latent variable modeling extensions of the latent growth curve model, as well as missing data procedures. The goal is to provide strategies for researchers considering IDA.

Indexed as

Data AnalysisRandomized Controlled Trials as TopicValidation Studies as TopicAdolescentBiasDepressionHumansLongitudinal StudiesHarmonizationIntegrative data analysisParticipant-level meta-analysisSynthesis methodology

Identifiers

PMID28434055
PMCPMC5651214
OpenAlexW2605922483

What OpenQuestion holds

Textmetadata
LicenceTDM
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.