Evidence map›Paper›PMID 40167802›Full record

ArticleSupportive care in cancer : official journal of the Multinational Association of Supportive Care in Cancer2025

AI-driven patient support: Evaluating the effectiveness of ChatGPT-4 in addressing queries about ovarian cancer compared with healthcare professionals in gynecologic oncology.

Hung-Hsueh Chou, Yi Hua Chen, Chiu-Tzu Lin, Hsien-Tsung Chang, An-Chieh Wu, Jia-Ling Tsai, Hsiao-Wei Chen, Ching-Chun Hsu, Shu-Ya Liu, Jian Tao Lee

Abstract readComparative Study
PubMed Publisher
In one paragraph

Article in Supportive care in cancer : official journal of the Multinational Association of Supportive Care in Cancer, 2025. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 3 papers.

0numbers the graph read from it
0cells of the map it votes in
3citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

3 citing papers in PubMed.

  1. Article
  2. Article
  3. Review
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

10 authors.

Hung-Hsueh ChouDepartment of Obstetrics and Gynecology, Linkou Branch, Chang Gung Memorial Hospital, Tao-Yuan, Taiwan.
Yi Hua ChenSchool of Nursing, College of Medicine, Chang Gung University, Tao-Yuan, Taiwan.
Chiu-Tzu LinNursing Department, Linkou Branch, Chang Gung Memorial Hospital, Tao-Yuan, Taiwan.
Hsien-Tsung ChangBachelor Program in Artificial Intelligence, Chang Gung University, Taoyuan 333, Tao-Yuan, Taiwan.
An-Chieh WuDepartment of Computer Science and Information Engineering, Chang Gung University, Taoyuan 333, Tao-Yuan, Taiwan.
Jia-Ling TsaiSchool of Nursing, College of Medicine, Chang Gung University, Tao-Yuan, Taiwan.
Hsiao-Wei ChenSchool of Nursing, College of Medicine, Chang Gung University, Tao-Yuan, Taiwan.
Ching-Chun HsuDepartment of Computer Science and Information Engineering, Chang Gung University, Taoyuan 333, Tao-Yuan, Taiwan.
Shu-Ya LiuSchool of Nursing, College of Medicine, Chang Gung University, Tao-Yuan, Taiwan.
Jian Tao LeeSchool of Nursing, College of Medicine, Chang Gung University, Tao-Yuan, Taiwan. jtlee@gap.cgu.edu.tw.

Funding

Chang Gung Medical Foundation BMRP398Ministry of Science and Technology Research, Taiwan grant numbers MOST 110-2629-H-182-001-MY2
6 · The paper itself

Abstract

purposeArtificial intelligence (AI) chatbots, such as ChatGPT-4, allow a user to ask questions on an interactive level. This study evaluated the correctness and completeness of responses to questions about ovarian cancer from a GPT-4 chatbot, LilyBot, compared with responses from healthcare professionals in gynecologic cancer care.

methodsFifteen categories of questions about ovarian cancer were collected from an online patient Chatgroup forum. Ten healthcare professionals in gynecologic oncology generated 150 questions and responses relative to these topics. Responses from LilyBot and the healthcare professionals were scored for correctness and completeness by eight independent healthcare professionals with similar backgrounds blinded to the identity of the responders. Differences between groups were analyzed with Mann-Whitney U and Kruskal-Wallis tests, followed by Tukey's post hoc comparisons.

resultsMean scores for overall performance for all 150 questions were significantly higher for LilyBot compared with the healthcare professionals for correctness (5.31 ± 0.98 vs. 5.07 ± 1.00, p = 0.017; range = 1-6) and completeness (2.66 ± 0.55 vs. 2.36 ± 0.55, p < 0.001; range = 1-3). LilyBot had significantly higher scores for immunotherapy compared with the healthcare professionals for correctness (6.00 ± 0.00 vs. 4.70 ± 0.48, p = 0.020) and completeness (3.00 ± 0.00 vs. 2.00 ± 0.00, p < 0.010); and gene therapy for completeness (3.00 ± 0.00 vs. 2.20 ± 0.42, p = 0.023).

conclusionsThe significantly better performance by LilyBot compared with healthcare professionals highlights the potential of ChatGPT-4-based dialogue systems to provide patients with clinical information about ovarian cancer.

Indexed as

Artificial IntelligenceHealth PersonnelOvarian NeoplasmsFemaleGenerative Artificial IntelligenceGynecologyHumansMedical OncologyArtificial intelligenceChatbotChatGPT-4Gynecologic oncologyOvarian cancer

Identifiers

What OpenQuestion holds

Textmetadata
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.