Evidence map›Paper›PMID 39507511›Full record

ArticleEuropean urology open science2024

Comparing Patient's Confidence in Clinical Capabilities in Urology: Large Language Models Versus Urologists.

Nicolas Carl, Lisa Nguyen, Sarah Haggenmüller, Martin Joachim Hetz, Jana Theres Winterstein, Friedrich Otto Hartung, Britta Gruene, Jakob Nikolas Kather, Tim Holland-Letz, Maurice Stephan Michel and 2 more

Abstract read
In one paragraph

Article in European urology open science, 2024. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 8 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
8citing papers in PubMed, 1 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

8 citing papers in PubMed, 1 synthesis or guideline pooled it.

  1. Pooled it
  2. Review
  3. Article
  4. Review
  5. Article
  6. Article
  7. Article
  8. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

12 authors.

Nicolas CarlDigital Biomarkers for Oncology Group, German Cancer Research Center (DKFZ), Heidelberg, Germany.
Lisa NguyenMedical Faculty Mannheim, Ruprecht-Karls University of Heidelberg, Mannheim, Germany.
Sarah HaggenmüllerDigital Biomarkers for Oncology Group, German Cancer Research Center (DKFZ), Heidelberg, Germany.
Martin Joachim HetzDigital Biomarkers for Oncology Group, German Cancer Research Center (DKFZ), Heidelberg, Germany.
Jana Theres WintersteinDigital Biomarkers for Oncology Group, German Cancer Research Center (DKFZ), Heidelberg, Germany.
Friedrich Otto HartungDepartment of Urology, University Medical Center Mannheim, Ruprecht-Karls University of Heidelberg, Mannheim, Germany.
Britta GrueneDepartment of Urology, University Medical Center Mannheim, Ruprecht-Karls University of Heidelberg, Mannheim, Germany.
Jakob Nikolas KatherMedical Faculty Carl Gustav Carus, Else Kroener Fresenius Center for Digital Health, TUD Dresden University of Technology, Dresden, Germany.
Tim Holland-LetzDepartment of Biostatistics, German Cancer Research Center (DKFZ), Heidelberg, Germany.
Maurice Stephan MichelDepartment of Urology, University Medical Center Mannheim, Ruprecht-Karls University of Heidelberg, Mannheim, Germany.
Frederik WesselsDepartment of Urology, University Medical Center Mannheim, Ruprecht-Karls University of Heidelberg, Mannheim, Germany.
Titus Josef BrinkerDigital Biomarkers for Oncology Group, German Cancer Research Center (DKFZ), Heidelberg, Germany.

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

Background and objective: Data on interaction of patients with artificial intelligence (AI) are limited, primarily derived from small-scale studies, cross-sectional surveys, and qualitative reviews. Most patients have not yet encountered AI in their clinical experience. This study explored patients' confidence in AI, specifically large language models, after a direct interaction with a chatbot in a clinical setting. Through hands-on experience, the study sought to reduce potential biases due to an anticipated lack of AI experience in a real-world urological patient sample. Methods: A total of 300 patients scheduled for counseling were enrolled from February to July 2024. Participants voluntarily conversed about their medical questions with a GPT-4 powered chatbot, followed by a survey assessing their confidence in clinical capabilities of AI compared with their counseling urologists. Clinical capabilities included history taking, diagnostics, treatment recommendation, anxiety reduction, and time allocation. Key findings and limitations: Of the 292 patients who completed the study, AI was significantly preferred to physicians for consultation time allocation ( Conclusions and clinical implications: Our study demonstrates that urological patients prefer AI as a powerful complement to-rather than a replacement for-human expertise in clinical care. Patients appreciated the additional consultation time provided by AI. Interestingly, age was not associated with confidence in AI, suggesting that large language models are user-friendly tools for patients of all age groups. Patient summary: In this report, we explored how patients feel about using an artificial intelligence (AI)-powered chatbot in a medical setting. Patients interacted with the AI for medical questions and compared its skills with those of doctors through a survey. They appreciated the AI for providing more time during consultations but preferred doctors for other tasks, for example, diagnostics, recommendation of treatments, and reduction of anxieties.

Indexed as

Clinical trialGenerative artificial intelligenceImplementation scienceLarge language modelsPatient interaction

Identifiers

PMID39507511
PMCPMC11538625

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.