Evidence map›Paper›PMID 38386789›Full record

ArticleInternational braz j urol : official journal of the Brazilian Society of Urology

Use of ChatGPT in Urology and its Relevance in Clinical Practice: Is it useful?

Antonio Vitor Nascimento Martinelli Braga, Noel Charlles Nunes, Emanoel Nascimento Santos, Maria Luiza Veiga, Ana Aparecida Nascimento Martinelli Braga, Glicia Estevam de Abreu, Jose de Bessa, Luis Henrique Braga, Andrew J Kirsch, Ubirajara Barroso

Open access · diamondAbstract read
In one paragraph

Article in International braz j urol : official journal of the Brazilian Society of Urology. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 12 papers.

0numbers the graph read from it
0cells of the map it votes in
12citing papers in PubMed
2.2field-weighted citation impact, top 12% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

12 citing papers in PubMed, 18 citations in OpenAlex.

  1. Trial
  2. Article
  3. Evaluation of ChatGPT's performance on answering pediatric urology questions based on association guidelines.Canadian Urological Association journal = Journal de l'Association des urologues du Canada · 2025
    Article
  4. Article
  5. Article
  6. Article
  7. Large Language Models and the "Centaur Model" in Urological Training in Latin America.International braz j urol : official journal of the Brazilian Society of Urology
    Article
  8. Use of ChatGPT in Urology and its Relevance in Clinical Practice: Comment.International braz j urol : official journal of the Brazilian Society of Urology
    Article
  9. Performance of ChatGPT and DeepSeek in the Management of Postprostatectomy Urinary IncontinenceInternational braz j urol : official journal of the Brazilian Society of Urology
    Article
  10. Can CHATGPT provides reliable technical medical information about phimosis?International braz j urol : official journal of the Brazilian Society of Urology
    Article
  11. Article
  12. Article
4 · The record

Corrections and comments

5 · Who and what money

Authors and funding

10 authors at 4 institutions in 3 countries.

Antonio Vitor Nascimento Martinelli BragaCentro de Distúrbios Urinários Infantis (CEDIMI), Escola Bahiana de Medicina e Saúde Pública, Salvador, BA, Brasil.
Noel Charlles NunesCentro de Distúrbios Urinários Infantis (CEDIMI), Escola Bahiana de Medicina e Saúde Pública, Salvador, BA, Brasil.
Emanoel Nascimento SantosCentro de Distúrbios Urinários Infantis (CEDIMI), Escola Bahiana de Medicina e Saúde Pública, Salvador, BA, Brasil.
Maria Luiza VeigaCentro de Distúrbios Urinários Infantis (CEDIMI), Escola Bahiana de Medicina e Saúde Pública, Salvador, BA, Brasil.
Ana Aparecida Nascimento Martinelli BragaCentro de Distúrbios Urinários Infantis (CEDIMI), Escola Bahiana de Medicina e Saúde Pública, Salvador, BA, Brasil.
Glicia Estevam de AbreuCentro de Distúrbios Urinários Infantis (CEDIMI), Escola Bahiana de Medicina e Saúde Pública, Salvador, BA, Brasil.
Jose de BessaFaculdade de Medicina, Universidade Estadual de Feira de Santana, Feira de Santana, BA, Brasil.
Luis Henrique BragaMcMaster University, Hamilton, Ontario, Canada.
Andrew J KirschPediatric Urology, Children's Healthcare of Atlanta and Emory University School of Medicine, Atlanta, GA, United States.
Ubirajara BarrosoCentro de Distúrbios Urinários Infantis (CEDIMI), Escola Bahiana de Medicina e Saúde Pública, Salvador, BA, Brasil.
Escola Bahiana de Medicina e Saúde Pública · BREmory University · USMcMaster University · CAUniversidade Estadual de Feira de Santana · BR

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

purpouseOne of the many artificial intelligence based tools that has gained popularity is the Chat-Generative Pre-Trained Transformer (ChatGPT). Due to its popularity, incorrect information provided by ChatGPT will have an impact on patient misinformation. Furthermore, it may cause misconduct as ChatGPT can mislead physicians on the decision-making pathway. Therefore, the aim of this study is to evaluate the accuracy and reproducibility of ChatGPT answers regarding urological diagnoses. MATERIALS AND

methodsChatGPT 3.5 version was used. The questions asked for the program involved Primary Megaureter (pMU), Enuresis and Vesicoureteral Reflux (VUR). There were three queries for each topic. The queries were inserted twice, and both responses were recorded to examine the reproducibility of ChatGPT's answers. Afterwards, both answers were combined. Finally, those rwere evaluated qualitatively by a board of three specialists. A descriptive analysis was performed. RESULTS AND

conclusionChatGPT simulated general knowledge on the researched topics. Regarding Enuresis, the provided definition was partially correct, as the generic response allowed for misinterpretation. For VUR, the response was considered appropriate. For pMU it was partially correct, lacking essential aspects of its definition such as the diameter of the dilatation of the ureter. Unnecessary exams were suggested, for Enuresis and pMU. Regarding the treatment of the conditions mentioned, it specified treatments for Enuresis that are ineffective, such as bladder training. Therefore, ChatGPT responses present a combination of accurate information, but also incomplete, ambiguous and, occasionally, misleading details.

Indexed as

Nocturnal EnuresisPhysiciansUrologyArtificial IntelligenceHumansReproducibility of ResultsCakut [Supplementary Concept]UrologyVesico-Ureteral Reflux

Identifiers

PMID38386789
PMCPMC10953603
OpenAlexW4393980797

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.