Evidence map›Paper›PMID 38233511›Full record

ArticleScientific reports2024

Availability of ChatGPT to provide medical information for patients with kidney cancer.

Joongwon Choi, Jin Wook Kim, Yong Seong Lee, Jong Hyun Tae, Se Young Choi, In Ho Chang, Jung Hoon Kim

Open access · goldAbstract read
In one paragraph

Article in Scientific reports, 2024. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 27 papers.

0numbers the graph read from it
0cells of the map it votes in
27citing papers in PubMed
4.2field-weighted citation impact, top 6% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

27 citing papers in PubMed, 35 citations in OpenAlex.

  1. Article
  2. Article
  3. Article
  4. Article
  5. Article
  6. Article
  7. Article
  8. Article
  9. Article
  10. Article
  11. Article
  12. Article
  13. Article
  14. Article
  15. Article
  16. Article
  17. Article
  18. Article
  19. Article
  20. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

7 authors at 2 institutions in 1 country.

Joongwon ChoiDepartment of Urology, Chung-Ang University Gwangmyeong Hospital, Chung-Ang University College of Medicine, Seoul, South Korea.ORCID 0000-0001-5978-8179
Jin Wook KimDepartment of Urology, Chung-Ang University Gwangmyeong Hospital, Chung-Ang University College of Medicine, Seoul, South Korea.ORCID 0000-0003-4157-9365
Yong Seong LeeDepartment of Urology, Chung-Ang University Gwangmyeong Hospital, Chung-Ang University College of Medicine, Seoul, South Korea.ORCID 0000-0003-0611-4554
Jong Hyun TaeDepartment of Urology, Chung-Ang University Hospital, Chung-Ang University College of Medicine, Seoul, South Korea.ORCID 0000-0001-5826-3469
Se Young ChoiDepartment of Urology, Chung-Ang University Hospital, Chung-Ang University College of Medicine, Seoul, South Korea.ORCID 0000-0002-4615-0966
In Ho ChangDepartment of Urology, Chung-Ang University Hospital, Chung-Ang University College of Medicine, Seoul, South Korea.ORCID 0000-0003-0240-1310
Jung Hoon KimDepartment of Urology, Chung-Ang University Gwangmyeong Hospital, Chung-Ang University College of Medicine, Seoul, South Korea. simbauro80@hanmail.net.ORCID 0000-0002-0947-876X
Chung-Ang University Hospital · KRSungae Hospital · KR

Funding

National Research Foundation of Korea 2021R1F1A1048198
6 · The paper itself

Abstract

ChatGPT is an advanced natural language processing technology that closely resembles human language. We evaluated whether ChatGPT could help patients understand kidney cancer and replace consultations with urologists. Two urologists developed ten questions commonly asked by patients with kidney cancer. The answers to these questions were produced using ChatGPT. The five-dimension SERVQUAL model was used to assess the service quality of ChatGPT. The survey was distributed to 103 urologists via email, and twenty-four urological oncologists specializing in kidney cancer were included as experts with more than 20 kidney cancer cases in clinic per month. All respondents were physicians. We received 24 responses to the email survey (response rate: 23.3%). The appropriateness rate for all ten answers exceeded 60%. The answer to Q2 received the highest agreement (91.7%, etiology of kidney cancer), whereas the answer to Q8 had the lowest (62.5%, comparison with other cancers). The experts gave low assessment ratings (44.4% vs. 93.3%, p = 0.028) in the SERVQUAL assurance (certainty of total answers) dimension. Positive scores for the overall understandability of ChatGPT answers were assigned by 54.2% of responders, and 70.8% said that ChatGPT could not replace explanations provided by urologists. Our findings affirm that although ChatGPT answers to kidney cancer questions are generally accessible, they should not supplant the counseling of a urologist.

Indexed as

Carcinoma, Renal CellKidney NeoplasmsAmbulatory Care FacilitiesElectronic MailHumansPatients

Identifiers

PMID38233511
PMCPMC10794224
OpenAlexW4390935802

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.