ArticleProstate cancer and prostatic diseases2025
Quality of information and appropriateness of Open AI outputs for prostate cancer.
Article in Prostate cancer and prostatic diseases, 2025. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 21 papers.
What it found
Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.
The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.
The trial behind it
Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.
Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.
Who cites it
21 citing papers in PubMed.
- Accuracy, readability, and understandability of EAU guidelines bot for testicular cancer.International urology and nephrology · 2026Article
- Best of 2025 in prostate cancer and prostatic diseases.Prostate cancer and prostatic diseases · 2026Article
- Additional predictive value of systemic inflammation indices beyond prostate specific antigen density for clinically significant prostate cancer.BMC urology · 2026Article
- Temporal evolution of large language models (LLMs) in oncology.Journal of translational medicine · 2025Article
- The Impact of Access to Clinical Guidelines on LLM-Based Treatment Recommendations for Chronic Hepatitis B.Liver international : official journal of the International Association for the Study of the Liver · 2025Article
- Evaluating the Competence of AI Chatbots in Answering Patient-Oriented Frequently Asked Questions on Orthognathic Surgery.Healthcare (Basel, Switzerland) · 2025Article
- Review
- Accompanying the prostate cancer patient pathway: evaluation of novel clinical decision support software in patients with early diagnosis of prostate cancer.BMC medical informatics and decision making · 2025Article
- ChatGPT can help guide and empower patients after prostate cancer diagnosis.Prostate cancer and prostatic diseases · 2025Article
- Evaluating an AI Chatbot "Prostate Cancer Info" for Providing Quality Prostate Cancer Screening Information: Cross-Sectional Study.JMIR cancer · 2025Article
- Letter to the Editor on "Physician vs. AI-generated messages in urology: evaluation of accuracy, completeness, and preference by patients and physicians".World journal of urology · 2025Article
- Patient- and clinician-based evaluation of large language models for patient education in prostate cancer radiotherapy.Strahlentherapie und Onkologie : Organ der Deutschen Rontgengesellschaft ... [et al] · 2025Article
- Improving clinical efficiency using retrieval-augmented generation in urologic oncology: A guideline-enhanced artificial intelligence approach.BJUI compass · 2025Article
- Accountability in AI medicine: A critical appraisal of ChatGPT in patient self-management and screening.Clinical and molecular hepatology · 2025Article
- Clinically Significant Prostate Cancer Prediction Using Multimodal Deep Learning with Prostate-Specific Antigen Restriction.Current oncology (Toronto, Ont.) · 2024Article
- Effectiveness of the Medical Chatbot PROSCA to Inform Patients About Prostate Cancer: Results of a Randomized Controlled Trial.European urology open science · 2024Article
- Large language model use in clinical oncology.NPJ precision oncology · 2024Article
- Transvaginal Natural Orifice Transluminal Endoscopic Surgery (vNOTES) in Urogynecological Surgery: A Systematic Review.Journal of clinical medicine · 2024Review
- Evaluation of Peri-Operative Outcomes after Prostatic Urethral Lift with Emphasis on Urodynamic Changes, Symptom Improvement and Sexual Function.Diagnostics (Basel, Switzerland) · 2024Article
- Performance of large language models (LLMs) in providing prostate cancer information.BMC urology · 2024Article
Corrections and comments
PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.
Authors and funding
16 authors.
Funding
No grant is acknowledged in the PubMed record.
Abstract
Chat-GPT, a natural language processing (NLP) tool created by Open-AI, can potentially be used as a quick source for obtaining information related to prostate cancer. This study aims to analyze the quality and appropriateness of Chat-GPT's responses to inquiries related to prostate cancer compared to those of the European Urology Association's (EAU) 2023 prostate cancer guidelines. Overall, 195 questions were prepared according to the recommendations gathered in the prostate cancer section of the EAU 2023 Guideline. All questions were systematically presented to Chat-GPT's August 3 Version, and two expert urologists independently assessed and assigned scores ranging from 1 to 4 to each response (1: completely correct, 2: correct but inadequate, 3: a mix of correct and misleading information, and 4: completely incorrect). Sub-analysis per chapter and per grade of recommendation were performed. Overall, 195 recommendations were evaluated. Overall, 50/195 (26%) were completely correct, 51/195 (26%) correct but inadequate, 47/195 (24%) a mix of correct and misleading and 47/195 (24%) incorrect. When looking at different chapters Open AI was particularly accurate in answering questions on follow-up and QoL. Worst performance was recorded for the diagnosis and treatment chapters with respectively 19% and 30% of the answers completely incorrect. When looking at the strength of recommendation, no differences in terms of accuracy were recorded when comparing weak and strong recommendations (p > 0,05). Chat-GPT has a poor accuracy when answering questions on the PCa EAU guidelines recommendations. Future studies should assess its performance after adequate training.
Indexed as
Identifiers
38228809What OpenQuestion holds
Registered trials
Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.