Evidence map›Paper›PMID 37947431›Full record

ArticleJournal of clinical child and adolescent psychology : the official journal for the Society of Clinical Child and Adolescent Psychology, American Psychological Association, Division 53

External and Internal Validity Considerations in Youth Effectiveness Trials: Lessons Learned from the COMET Study.

Amanda Jensen-Doss, Grace Woodard, Zabin Patel-Syed, Jill Ehrenreich-May, David Rosenfield, Golda S Ginsburg

Open access · greenAbstract read
In one paragraph

Article in Journal of clinical child and adolescent psychology : the official journal for the Society of Clinical Child and Adolescent Psychology, American Psychological Association, Division 53. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 1 paper.

0numbers the graph read from it
0cells of the map it votes in
1citing papers in PubMed
0.6field-weighted citation impact, top 28% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

1 citing paper in PubMed, 2 citations in OpenAlex.

  1. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

6 authors at 4 institutions in 1 country.

Amanda Jensen-DossDepartment of Psychology, University of Miami.ORCID 0000-0003-4995-7463
Grace WoodardDepartment of Psychology, University of Miami.ORCID 0000-0002-6747-6914
Zabin Patel-SyedCenter for Dissemination and Implementation Science, Northwestern University Feinberg School of Medicine.ORCID 0000-0002-0250-0848
Jill Ehrenreich-MayDepartment of Psychology, University of Miami.ORCID 0000-0001-7436-5393
David RosenfieldDepartment of Psychology, Southern Methodist University.ORCID 0000-0002-3743-9186
Golda S GinsburgDepartment of Psychiatry, University of Connecticut School of Medicine.ORCID 0000-0001-5172-2079
University of Miami · USNorthwestern University · USSouthern Methodist University · USUniversity of Connecticut · US

Funding

2/2-Unified Treatment of Adolescent Emotional Disorders in Community ClinicsR01MH106657 · NIMH · UNIVERSITY OF CONNECTICUT SCH OF MED/DNT · PI GINSBURG, GOLDA SUSAN · 2015 to 2018
$1.6M
1/2-Unified Treatment of Adolescent Emotional Disorders in Community ClinicsR01MH106536 · NIMH · UNIVERSITY OF MIAMI CORAL GABLES · PI EHRENREICH-MAY, JILL, JENSEN-DOSS, AMANDA · 2015 to 2018
$1.4M
NIMH NIH HHS R01 MH106536NIMH NIH HHS R01 MH106657
6 · The paper itself

Abstract

objectiveEffectiveness trials aim to increase the generalizability and public health impact of interventions. However, challenges associated with this design present threats to external and internal validity. This paper illustrates these challenges using data from a two-site randomized effectiveness trial, the Community Study of Outcome Monitoring for Emotional Disorders in Teens (COMET) and presents recommendations for future research.

methodCOMET was a randomized effectiveness trial conducted in 19 community mental health clinics in two states comparing three interventions: treatment as usual (TAU), TAU with measurement-based care (TAU+), and the Unified Protocol forTransdiagnostic Treatment of Emotional Disorders in Adolescents with MBC (UPA). Participants included 176 clinicians (mean age = 35.5; 85.8% cisgender female; 53.0% racially and/or ethnically minorized) and 196 adolescents (mean age = 14.7; 65.3% cisgender female; 69.4% racially and/or ethnically minorized). Analyses outlined participant flow from recruitment to study completion, described participant characteristics, and examined site differences.

resultsAnalysis of participant flow suggested that recruitment and retention of clinicians and adolescents was challenging, raising questions about whether participants were representative of participating clinics. Both the clinician and adolescent samples were racially and ethnically diverse and adolescents were low income and clinically complex. Significant site differences were observed in clinician and adolescent characteristics.

conclusionsWhile this study was successful in recruiting a diverse and historically under-represented sample, difficulties in recruitment and retention raise questions about external validity and site differences present challenges to internal validity of study findings. Suggestions for future effectiveness studies, drawing from implementation science approaches, are discussed.

Indexed as

Patient SelectionRandomized Controlled Trials as TopicAdolescentCommunity Mental Health CentersFemaleHumansMaleMinority Groups

Identifiers

PMID37947431
PMCPMC10655847
OpenAlexW4388566506

What OpenQuestion holds

Textmetadata
LicenceTDM
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.