Evidence map›Paper›PMID 40211256›Full record

ArticleBMC psychiatry2025

Evaluating the agreement between ChatGPT-4 and validated questionnaires in screening for anxiety and depression in college students: a cross-sectional study.

Jiali Liu, Juan Gu, Mengjie Tong, Yake Yue, Yufei Qiu, Lijuan Zeng, Yiqing Yu, Fen Yang, Shuyan Zhao

Abstract read
In one paragraph

Article in BMC psychiatry, 2025. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 4 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
4citing papers in PubMed, 1 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

4 citing papers in PubMed, 1 synthesis or guideline pooled it.

  1. Pooled it
  2. Article
  3. Article
  4. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

9 authors.

Jiali LiuSchool of Nursing, Hubei University of Chinese Medicine, No. 16 West Huangjiahu Road, Hongshan District, Wuhan, 430065, China.
Juan GuSchool of Nursing, Hubei University of Chinese Medicine, No. 16 West Huangjiahu Road, Hongshan District, Wuhan, 430065, China.
Mengjie TongSchool of Nursing, Hubei University of Chinese Medicine, No. 16 West Huangjiahu Road, Hongshan District, Wuhan, 430065, China.
Yake YueSchool of Nursing, Hubei University of Chinese Medicine, No. 16 West Huangjiahu Road, Hongshan District, Wuhan, 430065, China.
Yufei QiuSchool of Nursing, Hubei University of Chinese Medicine, No. 16 West Huangjiahu Road, Hongshan District, Wuhan, 430065, China.
Lijuan ZengSchool of Nursing, Hubei University of Chinese Medicine, No. 16 West Huangjiahu Road, Hongshan District, Wuhan, 430065, China.
Yiqing YuSchool of Nursing, Hubei University of Chinese Medicine, No. 16 West Huangjiahu Road, Hongshan District, Wuhan, 430065, China.
Fen YangSchool of Nursing, Hubei University of Chinese Medicine, No. 16 West Huangjiahu Road, Hongshan District, Wuhan, 430065, China. fenyang@hbucm.edu.cn.
Shuyan ZhaoNursing Department, Hubei Provincial Hospital of Traditional Chinese Medicine, No. 856 Luoyu Road, Hongshan District, Wuhan, Hubei, China. 814270350@qq.com.

Funding

Traditional Chinese Medicine Innovation and Development Joint Fund 2023AFD160
6 · The paper itself

Abstract

backgroundThe Chat Generative Pre-trained Transformer (ChatGPT), an artificial intelligence-based web application, has demonstrated substantial potential across various knowledge domains, particularly in medicine. This cross-sectional study assessed the validity and possible usefulness of the ChatGPT-4 in assessing anxiety and depression by comparing two questionnaires.

methodsThis study tasked ChatGPT-4 with generating a structured interview questionnaire based on the validated Patient Health Questionnaire-9 (PHQ-9) and Generalized Anxiety Disorder Scale-7 (GAD-7). These new measures were referred to as GPT-PHQ-9 and GPT-GAD-7. This study utilized Spearman correlation analysis, Intra-class correlation coefficients (ICC), Youden's index, receiver operating characteristic (ROC) and Bland-Altman plots to evaluate the consistency between scores from a ChatGPT-4 adapted questionnaire and those from a validated questionnaire.

resultsA total of 200 college students participated. Cronbach's α indicated acceptable reliability for both GPT-PHQ-9 (α = 0.75) and GPT-GAD-7 (α = 0.76). ICC values were 0.80 for PHQ-9 and 0.70 for GAD-7. Spearman's correlation showed moderate associations with PHQ-9 (p = 0.63) and GAD-7 (p = 0.68). ROC curve analysis revealed optimal cutoffs of 9.5 for depressive symptoms and 6.5 for anxiety symptoms, both with high sensitivity and specificity.

conclusionsThe questionnaire adapted by ChatGPT-4 demonstrated good consistency with the validated questionnaire. Future studies should investigate the usefulness of the ChatGPT designed questionnaire in different populations.

Indexed as

AnxietyAnxiety DisordersDepressionPsychiatric Status Rating ScalesStudentsAdolescentAdultCross-Sectional StudiesFemaleGenerative Artificial IntelligenceHumansMaleMass ScreeningPsychometricsReproducibility of ResultsROC CurveAnxietyArtificial intelligenceChatGPTDepression; questionnaire

Identifiers

PMID40211256
PMCPMC11983836

What OpenQuestion holds

Textmetadata
LicenceCC BY-NC-ND
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.