Evidence map›Paper›PMID 38179200›Full record

ArticleFrontiers in neuroimaging2023

Recalibrating single-study effect sizes using hierarchical Bayesian models.

Zhipeng Cao, Matthew McCabe, Peter Callas, Renata B Cupertino, Jonatan Ottino-González, Alistair Murphy, Devarshi Pancholi, Nathan Schwab, Orr Catherine, Kent Hutchison and 29 more

Abstract read
In one paragraph

Article in Frontiers in neuroimaging, 2023. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 3 papers.

0numbers the graph read from it
0cells of the map it votes in
3citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

3 citing papers in PubMed.

  1. Article
  2. Reporting checklists in neuroimaging: promoting transparency, replicability, and reproducibility.Neuropsychopharmacology : official publication of the American College of Neuropsychopharmacology · 2024
    Review
  3. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

39 authors.

Zhipeng CaoShanghai Xuhui Mental Health Center, Shanghai, China.
Matthew McCabeDepartment of Psychiatry, University of Vermont College of Medicine, Burlington, VT, United States.
Peter CallasDepartment of Mathematics and Statistics, University of Vermont College of Engineering and Mathematical Sciences, Burlington, VT, United States.
Renata B CupertinoDepartment of Psychiatry, University of Vermont College of Medicine, Burlington, VT, United States.
Jonatan Ottino-GonzálezDepartment of Psychiatry, University of Vermont College of Medicine, Burlington, VT, United States.
Alistair MurphyDepartment of Psychiatry, University of Vermont College of Medicine, Burlington, VT, United States.
Devarshi PancholiDepartment of Psychiatry, University of Vermont College of Medicine, Burlington, VT, United States.
Nathan SchwabDepartment of Psychiatry, University of Vermont College of Medicine, Burlington, VT, United States.
Orr CatherineDepartment of Psychological Sciences, School of Health Sciences, Swinburne University, Melbourne, VIC, Australia.
Kent HutchisonDepartment of Psychology and Neuroscience, University of Colorado Boulder, Boulder, CO, United States.
Janna CousijnDepartment of Psychology, Education and Child Studies, Erasmus University Rotterdam, Rotterdam, Netherlands.
Alain DagherDepartment of Neurology and Neurosurgery, Montreal Neurological Institute, McGill University, Montreal, QC, Canada.
John J FoxeDepartment of Neuroscience, The Ernest J. Del Monte Institute for Neuroscience, University of Rochester School of Medicine and Dentistry, Rochester, NY, United States.
Anna E GoudriaanDepartment of Psychiatry, Amsterdam UMC, University of Amsterdam, Amsterdam, Netherlands.
Robert HesterMelbourne School of Psychological Sciences, University of Melbourne, Melbourne, VIC, Australia.
Chiang-Shan R LiDepartment of Psychiatry, Yale University School of Medicine, New Haven, CT, United States.
Wesley K ThompsonLaureate Institute for Brain Research, Tulsa, OK, United States.
Angelica M MoralesDepartment of Psychiatry at Oregon Health and Science University, Portland, OR, United States.
Edythe D LondonDavid Geffen School of Medicine, University of California at Los Angeles, Los Angeles, CA, United States.
Valentina LorenzettiNeuroscience of Addiction and Mental Health Program, Healthy Brain and Mind Research Centre, School of Behavioural & Health Sciences, Faculty of Health Sciences, Australian Catholic University, Australia.
Maartje LuijtenBehavioural Science Institute, Radboud University, Nijmegen, Netherlands.
Rocio Martin-SantosDepartment of Psychiatry and Psychology, University of Barcelona, Barcelona, Spain.
Reza MomenanClinical NeuroImaging Research Core, Division of Intramural Clinical and Biological Research, National Institute on Alcohol Abuse and Alcoholism, Bethesda, MD, United States.
Martin P PaulusLaureate Institute for Brain Research, Tulsa, OK, United States.
Lianne SchmaalOrygen, Parkville, VIC, Australia.
Rajita SinhaDepartment of Psychiatry, Yale University School of Medicine, New Haven, CT, United States.
Nadia SolowijSchool of Psychology and Illawarra Health and Medical Research Institute, University of Wollongong, Wollongong, NSW, Australia.
Dan J SteinSA MRC Unit on Risk and Resilience in Mental Disorders, Department of Psychiatry and Neuroscience Institute, University of Cape Town, Cape Town, South Africa.
Elliot A SteinNeuroimaging Research Branch, Intramural Research Program, National Institute on Drug Abuse, Baltimore, MD, United States.
Anne UhlmannDepartment of Child and Adolescent Psychiatry and Psychotherapy, Technische Universität Dresden, Dresden, Germany.
Ruth J van HolstDepartment of Psychiatry, Amsterdam UMC, University of Amsterdam, Amsterdam, Netherlands.
Dick J VeltmanDepartment of Psychiatry, Amsterdam UMC, University of Amsterdam, Amsterdam, Netherlands.
Reinout W WiersAddiction Development and Psychopathology (ADAPT)-Lab, Department of Psychology and Center for Urban Mental Health, University of Amsterdam, Amsterdam, Netherlands.
Murat YücelBrainPark, Turner Institute for Brain and Mental Health, School of Psychological Sciences, and Monash Biomedical Imaging Facility, Monash University, Melbourne, VIC, Australia.
Sheng ZhangDepartment of Psychiatry, Yale University School of Medicine, New Haven, CT, United States.
Patricia ConrodDepartment of Psychiatry, Université de Montreal, CHU Ste Justine Hospital, Montreal, QC, Canada.
Scott MackeyDepartment of Psychiatry, University of Vermont College of Medicine, Burlington, VT, United States.
Hugh GaravanDepartment of Psychiatry, University of Vermont College of Medicine, Burlington, VT, United States.
ENIGMA Addiction Working Group

Funding

Chronic Alcohol and Brain Stress Circuit ResponseR01AA013892 · NIAAA · YALE UNIVERSITY · PI Rajita Sinha · 2003 to 2026
$10.1M
Functional & Structural Connectivity of Alcohol Use DisordersZIAAA000123 · NIAAA · NATIONAL INSTITUTE ON ALCOHOL ABUSE AND ALCOHOLISM · PI MOMENAN, REZA · 2015 to 2022
$7.8M
ENIGMA- Addiction: Pooling of Existing Datasets to Identify Brain and Genetic Correlates of Addiction, Next StepsR01DA047119 · NIDA · UNIVERSITY OF VERMONT & ST AGRIC COLLEGE · PI HUGH P. GARAVAN · 2018 to 2026
$5.4M
Cognitive control and cocaine dependence: thalamic noradrenergic processesR01DA023248 · NIDA · YALE UNIVERSITY · PI LI, CHIANG-SHAN RAY · 2008 to 2018
$4.0M
Protocols, Statistics, Collaborative Method Development and ToolsPL1DA024859 · NIDA · YALE UNIVERSITY · PI SINHA, RAJITA · 2007 to 2011
$3.6M
Neural Systems, Inhibitory Control, and Methamphetamine DependenceR01DA020726 · NIDA · UNIVERSITY OF CALIFORNIA LOS ANGELES · PI LONDON, EDYTHE DANICK · 2005 to 2008
$2.0M
A global alliance to unlock brain mechanisms influencing suicidal behaviors through the ENIGMA ConsortiumR01MH117601 · NIMH · UNIVERSITY OF SOUTHERN CALIFORNIA · PI JAHANSHAD, NEDA, SCHMAAL, LIANNE · 2018 to 2021
$1.5M
STIMULANT DEPENDENCE: NEURAL MECHANISMS OF RELAPSER01DA018307 · NIDA · UNIVERSITY OF CALIFORNIA, SAN DIEGO · PI PAULUS, MARTIN P. · 2004 to 2008
$1.3M
Cerebral Correlates of Early Habitual DrinkingR01AA021449 · NIAAA · YALE UNIVERSITY · PI LI, CHIANG-SHAN RAY · 2013 to 2017
$1.2M
Imaging the monoaminergic midbrain and cognitive control in cocaine addictionR21DA044749 · NIDA · YALE UNIVERSITY · PI LI, CHIANG-SHAN RAY · 2018 to 2019
$704k
A cholinergic mechanism of impulsive response in young adult cigarette smokersR21DA045189 · NIDA · YALE UNIVERSITY · PI LI, CHIANG-SHAN RAY · 2018 to 2019
$401k
Intramural NIH HHS ZIA AA000123NIAAA NIH HHS R01 AA013892NIAAA NIH HHS R01 AA021449NIDA NIH HHS PL1 DA024859NIDA NIH HHS R01 DA018307NIDA NIH HHS R01 DA020726NIDA NIH HHS R01 DA023248NIDA NIH HHS R01 DA047119NIDA NIH HHS R21 DA044749NIDA NIH HHS R21 DA045189NIMH NIH HHS R01 MH117601
6 · The paper itself

Abstract

Introduction: There are growing concerns about commonly inflated effect sizes in small neuroimaging studies, yet no study has addressed recalibrating effect size estimates for small samples. To tackle this issue, we propose a hierarchical Bayesian model to adjust the magnitude of single-study effect sizes while incorporating a tailored estimation of sampling variance. Methods: We estimated the effect sizes of case-control differences on brain structural features between individuals who were dependent on alcohol, nicotine, cocaine, methamphetamine, or cannabis and non-dependent participants for 21 individual studies (Total cases: 903; Total controls: 996). Then, the study-specific effect sizes were modeled using a hierarchical Bayesian approach in which the parameters of the study-specific effect size distributions were sampled from a higher-order overarching distribution. The posterior distribution of the overarching and study-specific parameters was approximated using the Gibbs sampling method. Results: The results showed shrinkage of the posterior distribution of the study-specific estimates toward the overarching estimates given the original effect sizes observed in individual studies. Differences between the original effect sizes (i.e., Cohen's d) and the point estimate of the posterior distribution ranged from 0 to 0.97. The magnitude of adjustment was negatively correlated with the sample size (r = -0.27, Discussion: Our findings demonstrate the utility of the hierarchical Bayesian model in recalibrating single-study effect sizes using information from similar studies. This suggests that Bayesian utilization of existing knowledge can be an effective alternative approach to improve the effect size estimation in individual studies, particularly for those with smaller samples.

Indexed as

case-control differenceseffect size recalibrationhierarchical Bayesian modelinflated effect sizesmall sample sizesubstance dependence

Identifiers

PMID38179200
PMCPMC10764546

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.