Evidence map›Paper›PMID 37400814›Full record

ArticleBMC medicine2023

Sampling inequalities affect generalization of neuroimaging-based diagnostic classifiers in psychiatry.

Zhiyi Chen, Bowen Hu, Xuerong Liu, Benjamin Becker, Simon B Eickhoff, Kuan Miao, Xingmei Gu, Yancheng Tang, Xin Dai, Chao Li and 5 more

Abstract read
In one paragraph

Article in BMC medicine, 2023. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 16 papers.

0numbers the graph read from it
0cells of the map it votes in
16citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

16 citing papers in PubMed.

  1. Article
  2. Review
  3. Article
  4. Review
  5. Article
  6. Article
  7. Article
  8. Article
  9. Article
  10. Current best practices and future opportunities for reproducible findings using large-scale neuroimaging in psychiatry.Neuropsychopharmacology : official publication of the American College of Neuropsychopharmacology · 2024
    Review
  11. Racial and ethnic socioenvironmental inequity and neuroimaging in psychiatry: a brief review of the past and recommendations for the future.Neuropsychopharmacology : official publication of the American College of Neuropsychopharmacology · 2024
    Review
  12. Article
  13. Review
  14. Article
  15. Our Hopes forJAACAP open · 2023
    Article
  16. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

15 authors.

Zhiyi ChenExperimental Research Center for Medical and Psychological Science (ERC-MPS), School of Psychology, Third Military Medical University, Chongqing, China. chenzhiyi@tmmu.edu.cn.
Bowen HuFaculty of Psychology, Southwest University, Chongqing, China.
Xuerong LiuExperimental Research Center for Medical and Psychological Science (ERC-MPS), School of Psychology, Third Military Medical University, Chongqing, China.
Benjamin BeckerThe Center of Psychosomatic Medicine, Sichuan Provincial Center for Mental Health, Sichuan Provincial People's Hospital, Chengdu, China.
Simon B EickhoffInstitute of Systems Neuroscience, Heinrich Heine University Düsseldorf, Düsseldorf, Germany.
Kuan MiaoExperimental Research Center for Medical and Psychological Science (ERC-MPS), School of Psychology, Third Military Medical University, Chongqing, China.
Xingmei GuExperimental Research Center for Medical and Psychological Science (ERC-MPS), School of Psychology, Third Military Medical University, Chongqing, China.
Yancheng TangSchool of Business and Management, Shanghai International Studies University, Shanghai, China.
Xin DaiFaculty of Psychology, Southwest University, Chongqing, China.
Chao LiDepartment of Radiology, The Third Affiliated Hospital, Sun Yat-Sen University, Guangdong, China.
Artemiy LeonovSchool of Psychology, Clark University, Worcester, MA, USA.
Zhibing XiaoState Key Laboratory of Cognitive Neuroscience and Learning, Beijing Normal University, Beijing, China.
Zhengzhi FengExperimental Research Center for Medical and Psychological Science (ERC-MPS), School of Psychology, Third Military Medical University, Chongqing, China.
Ji ChenDepartment of Psychology and Behavioral Sciences, Zhejiang University, Hangzhou, China. ji.chen@zju.edu.cn.
Hu Chuan-PengSchool of Psychology, Nanjing Normal University, Nanjing, China.

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

backgroundThe development of machine learning models for aiding in the diagnosis of mental disorder is recognized as a significant breakthrough in the field of psychiatry. However, clinical practice of such models remains a challenge, with poor generalizability being a major limitation.

methodsHere, we conducted a pre-registered meta-research assessment on neuroimaging-based models in the psychiatric literature, quantitatively examining global and regional sampling issues over recent decades, from a view that has been relatively underexplored. A total of 476 studies (n = 118,137) were included in the current assessment. Based on these findings, we built a comprehensive 5-star rating system to quantitatively evaluate the quality of existing machine learning models for psychiatric diagnoses.

resultsA global sampling inequality in these models was revealed quantitatively (sampling Gini coefficient (G) = 0.81, p < .01), varying across different countries (regions) (e.g., China, G = 0.47; the USA, G = 0.58; Germany, G = 0.78; the UK, G = 0.87). Furthermore, the severity of this sampling inequality was significantly predicted by national economic levels (β =  - 2.75, p < .001, R

conclusionsTogether, improving sampling economic equality and hence the quality of machine learning models may be a crucial facet to plausibly translating neuroimaging-based diagnostic classifiers into clinical practice.

Indexed as

PsychiatryPsychotic DisordersHumansMachine LearningNeuroimagingResearch DesignDiagnostic classificationMeta-analysisNeuroimagingPsychiatric machine learningSampling inequalities

Identifiers

PMID37400814
PMCPMC10318841

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.