Evidence map›Paper›PMID 41555309›Full record

ArticleBMC urology2026

Estimation of IPSS and OABSS scores using ChatGPT-4o: a comparative validation study in Korea.

Hoyoung Bae, Gyu Min Lee, Jiehyeon Lee, Jung Hoon Lee, Sangjun Yoo, Min Chul Cho, Hyeon Jeong, Hwancheol Son

Abstract readValidation StudyComparative Study
In one paragraph

Article in BMC urology, 2026. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 1 paper.

0numbers the graph read from it
0cells of the map it votes in
1citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

1 citing paper in PubMed.

  1. Review
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

8 authors.

Hoyoung BaeDepartment of Urology, Seoul National University Boramae Medical Center, Sindaebang 2(i)-dong, Dongjak-gu, Seoul, 07061, Korea.
Gyu Min LeeDepartment of Urology, Seoul National University Boramae Medical Center, Sindaebang 2(i)-dong, Dongjak-gu, Seoul, 07061, Korea.
Jiehyeon LeeDepartment of Urology, Seoul National University Boramae Medical Center, Sindaebang 2(i)-dong, Dongjak-gu, Seoul, 07061, Korea.
Jung Hoon LeeDepartment of Urology, Seoul National University Boramae Medical Center, Sindaebang 2(i)-dong, Dongjak-gu, Seoul, 07061, Korea.
Sangjun YooDepartment of Urology, Seoul National University Boramae Medical Center, Sindaebang 2(i)-dong, Dongjak-gu, Seoul, 07061, Korea.
Min Chul ChoDepartment of Urology, Seoul National University Boramae Medical Center, Sindaebang 2(i)-dong, Dongjak-gu, Seoul, 07061, Korea.
Hyeon JeongDepartment of Urology, Seoul National University Boramae Medical Center, Sindaebang 2(i)-dong, Dongjak-gu, Seoul, 07061, Korea.
Hwancheol SonDepartment of Urology, Seoul National University Boramae Medical Center, Sindaebang 2(i)-dong, Dongjak-gu, Seoul, 07061, Korea. volley@snu.ac.kr.

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

purposeTo evaluate the performance of ChatGPT-4o in estimating International Prostate Symptom Score (IPSS) and Overactive Bladder Symptom Score (OABSS) based on patients’ natural language descriptions and full outpatient records, compared to actual questionnaire scores. MATERIALS AND

methodsThis study included 91 patients, of whom 52 completed IPSS and 77 completed OABSS. ChatGPT-4o was prompted with verbatim symptom statements and full medical records written by a urologist. Predicted scores were compared to actual scores using paired t-tests, weighted Cohen’s kappa for item-level agreement, Spearman’s correlation for total scores, and Bland–Altman plots for bias. Diagnostic classifications (lower urinary tract symptoms [LUTS]: IPSS ≥8; overactive bladder [OAB]: OABSS ≥3 with urgency ≥2) were assessed using McNemar’s test and receiver operating characteristic curve analysis.

resultsMean IPSS scores estimated by ChatGPT-4o were statistically significantly lower than patient-reported scores (11.2 vs. 13.6, p = 0.006), whereas OABSS scores did not differ significantly between the two methods (6.99 vs. 6.86, p = 0.686). Diagnostic agreement was high: LUTS in 42 (actual) vs. 38 (GPT) patients, and OAB in 51 vs. 50 patients. Area under curve was 0.81 for IPSS and 0.91 for OABSS. Kappa values ranged from 0.23–0.81 (IPSS) and 0.44–0.71 (OABSS), with highest concordance in quality of life (QoL) and urgency incontinence. Spearman’s correlation coefficient was 0.60 (IPSS) and 0.70 (OABSS). Accuracy was lower in first-visit patients.

conclusionsGPT-4o estimated IPSS and OABSS with moderate but clinically acceptable accuracy. Its performance was comparable regarding diagnostic classification, particularly for QoL and OABSS. ChatGPT-4o may complement traditional questionnaires, particularly with missing or incomplete patient-reported data.

Indexed as

Lower Urinary Tract SymptomsSeverity of Illness IndexUrinary Bladder, OveractiveAgedHumansMaleMiddle AgedRepublic of KoreaSurveys and QuestionnairesAI(Artificial intelligence)ChatGPTIPSSLLM(Large language model)LUTS(Low urinary tract symptoms)OAB(Overactive bladder)OABSS

Identifiers

PMID41555309
PMCPMC12961824

What OpenQuestion holds

Textmetadata
LicenceCC BY-NC-ND
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.