Evidence map›Paper›PMID 40857549›Full record

ArticleInternational braz j urol : official journal of the Brazilian Society of Urology

Performance of ChatGPT and DeepSeek in the Management of Postprostatectomy Urinary Incontinence

Vicktor Bruno Pereira Pinto, Romullo José Costa Ataídes, Lucas Antônio Pereira do Nascimento, Cristiane de Barros Gaspar, Priscila Ferreira Alves, Magnum Adriel Santos Pereira, Manoel José de Macedo, Willian Carlos Nahas, José de Bessa, Cristiano Mendes Gomes

Abstract readComparative Study
In one paragraph

Article in International braz j urol : official journal of the Brazilian Society of Urology. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 6 papers.

0numbers the graph read from it
0cells of the map it votes in
6citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

6 citing papers in PubMed.

  1. Article
  2. Article
  3. Article
  4. Article
  5. Article
  6. Large Language Models and the "Centaur Model" in Urological Training in Latin America.International braz j urol : official journal of the Brazilian Society of Urology
    Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

10 authors.

Vicktor Bruno Pereira PintoDivisão de Urologia, Faculdade de Medicina da Universidade de São Paulo - FMUSP, São Paulo, Brasil.
Romullo José Costa AtaídesDivisão de Urologia, Faculdade de Medicina da Universidade de São Paulo - FMUSP, São Paulo, Brasil.
Lucas Antônio Pereira do NascimentoDivisão de Urologia, Faculdade de Medicina da Universidade de São Paulo - FMUSP, São Paulo, Brasil.
Cristiane de Barros GasparDivisão de Urologia, Faculdade de Medicina da Universidade de São Paulo - FMUSP, São Paulo, Brasil.
Priscila Ferreira AlvesDivisão de Urologia, Faculdade de Medicina da Universidade de São Paulo - FMUSP, São Paulo, Brasil.
Magnum Adriel Santos PereiraServiço de Urologia do Hospital do Servidor Público Estadual de São Paulo -HSPE - IAMSPE, São Paulo, SP, Brasil.
Manoel José de MacedoCentro Universitário UniDombosco - UNDB, São Luis, MA, Brasil.
Willian Carlos NahasDivisão de Urologia, Faculdade de Medicina da Universidade de São Paulo - FMUSP, São Paulo, Brasil.
José de BessaDepartamento de Cirurgia, Universidade Estadual de Feira de Santana - UEFS, Feira de Santana, BA, Brasil.
Cristiano Mendes GomesDivisão de Urologia, Faculdade de Medicina da Universidade de São Paulo - FMUSP, São Paulo, Brasil.

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

purposeArtificial intelligence (AI) continues to evolve as a tool in clinical decision support. Large language models (LLMs), such as ChatGPT and DeepSeek, are increasingly used in medicine to provide fast, accessible information. This study aimed to compare the performance of ChatGPT and DeepSeek in generating recommendations for the management of postprostatectomy urinary incontinence (PPUI), based on the AUA/SUFU guideline. MATERIALS AND

methodsA total of 20 questions (10 conceptual and 10 case-based) were developed by three urologists with expertise in PPUI, following the AUA/SUFU guideline. Each question was submitted in English using zero-shot prompting to ChatGPT-4o and DeepSeek R1. Responses were limited to 200 words and graded independently as correct (1 point), partially correct (0.5), or incorrect (0). Total and domain-specific scores were compared.

resultsChatGPT achieved 19 out of 20 points (95.0%), while DeepSeek scored 14.5 (72.5%; p = 0.031). In conceptual questions, scores were 9.0 (ChatGPT) and 8.0 (DeepSeek; p = 0.50). In case-based scenarios, ChatGPT scored 10.0 versus 6.5 for DeepSeek (p = 0.08). ChatGPT outperformed DeepSeek across all guideline domains. DeepSeek made critical errors in the treatment domain, such as recommending a male sling for radiated patients.

conclusionChatGPT demonstrated superior performance in providing guideline-based recommendations for PPUI. However, both models should be used under expert supervision, and future research is needed to optimize their safe integration into clinical workflows.

Indexed as

Artificial IntelligenceDecision Support Systems, ClinicalProstatectomyUrinary IncontinenceGenerative Artificial IntelligenceHumansMalePractice Guidelines as TopicReproducibility of ResultsSurveys and QuestionnairesArtificial IntelligenceClinical Decision-MakingUrinary Incontinence

Identifiers

PMID40857549
PMCPMC12539877

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.