Evidence map›Paper›PMID 40338279›Full record

Trial reportWorld journal of urology2025

Chatgpt vs traditional pedagogy: a comparative study in urological learning.

Alessio Digiacomo, Angelo Orsini, Rossella Cicchetti, Ludovica Spadano, Sara De Santis, Laura Di Sessa, Miriana Vitale, Marta Di Nicola, Flavia Tamborino, Martina Basconi and 6 more

Abstract readComparative StudyRandomized Controlled Trial
In one paragraph

Trial report in World journal of urology, 2025. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 7 papers, 4 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
7citing papers in PubMed, 4 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

7 citing papers in PubMed, 4 syntheses or guidelines pooled it.

  1. Pooled it
  2. Pooled it
  3. Pooled it
  4. Pooled it
  5. Trial
  6. Article
  7. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

16 authors.

Alessio DigiacomoDepartment of Medical, Oral and Biotechnological Sciences, "G. d'Annunzio" University of Chieti-Pescara, SS Annunziata Hospital, Urology Unit, Chieti, Italy. ale.digiacomo.uro@gmail.com.ORCID https://orcid.org/0009-0000-9312-2266
Angelo OrsiniDepartment of Medical, Oral and Biotechnological Sciences, "G. d'Annunzio" University of Chieti-Pescara, SS Annunziata Hospital, Urology Unit, Chieti, Italy.
Rossella CicchettiDepartment of Medical, Oral and Biotechnological Sciences, "G. d'Annunzio" University of Chieti-Pescara, SS Annunziata Hospital, Urology Unit, Chieti, Italy.
Ludovica SpadanoItalian Secretariat for Medical Students (SISM), Chieti, Italy.
Sara De SantisItalian Secretariat for Medical Students (SISM), Chieti, Italy.
Laura Di SessaItalian Secretariat for Medical Students (SISM), Chieti, Italy.
Miriana VitaleItalian Secretariat for Medical Students (SISM), Chieti, Italy.
Marta Di NicolaDepartment of Medical, Oral and Biotechnological Sciences, "G. d'Annunzio" University of Chieti-Pescara, Chieti, Italy.
Flavia TamborinoDepartment of Medical, Oral and Biotechnological Sciences, "G. d'Annunzio" University of Chieti-Pescara, SS Annunziata Hospital, Urology Unit, Chieti, Italy.
Martina BasconiDepartment of Medical, Oral and Biotechnological Sciences, "G. d'Annunzio" University of Chieti-Pescara, SS Annunziata Hospital, Urology Unit, Chieti, Italy.
Riccardo De ArchangelisDepartment of Medical, Oral and Biotechnological Sciences, "G. d'Annunzio" University of Chieti-Pescara, SS Annunziata Hospital, Urology Unit, Chieti, Italy.
Gaetano SalzanoDepartment of Medical, Oral and Biotechnological Sciences, "G. d'Annunzio" University of Chieti-Pescara, SS Annunziata Hospital, Urology Unit, Chieti, Italy.
Guglielmo Dello StrittoDepartment of Medical, Oral and Biotechnological Sciences, "G. d'Annunzio" University of Chieti-Pescara, SS Annunziata Hospital, Urology Unit, Chieti, Italy.
Peppino LannuttiDepartment of Medical, Oral and Biotechnological Sciences, "G. d'Annunzio" University of Chieti-Pescara, SS Annunziata Hospital, Urology Unit, Chieti, Italy.
Luigi SchipsDepartment of Medical, Oral and Biotechnological Sciences, "G. d'Annunzio" University of Chieti-Pescara, SS Annunziata Hospital, Urology Unit, Chieti, Italy.
Michele MarchioniDepartment of Medical, Oral and Biotechnological Sciences, "G. d'Annunzio" University of Chieti-Pescara, SS Annunziata Hospital, Urology Unit, Chieti, Italy.

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

purposeTechnological evolution is radically changing medical learning models. We evaluated the learning outcomes of urological concepts using ChatGPT, traditional lecture and combined approach.

methodsWe conducted a randomized triple-blind study on 121 medical students with no previous formal curriculum in urology. Students were randomly divided into three study classes with different learning methods: ChatGPT, Lecture and ChatGPT + Lecture. The "adrenal glands" were randomly extracted as the subject of the lessons. Students were evaluated using a thirty-question test.

resultsThe evaluation test median score was higher for students who underwent ChatGPT + Lecture compared with those who had only ChatGPT (10 vs. 12, p = 0.007). Such differences remained statistically significant also in multivariable models adjusting according to year of course, gender and previous ChatGPT experience (estimate: 2.6, p-value = 0.002). For most of the questions (about 70%), the proportion of students correctly answering was higher in the ChatGPT + Lecture learning groups than in the other groups.

conclusionChatGPT loses its potential if used without a previous background. The limits of scientific reliability persist and a teacher-guided method is still essential. ChatGPT + traditional lecture gives more effective results than the single traditional lecture also allowing a better use of the chatbot.

Indexed as

Education, Medical, UndergraduateUrologyAdultCurriculumEducational MeasurementFemaleGenerative Artificial IntelligenceHumansLearningMaleStudents, MedicalTeachingYoung AdultChatGPTLearning methodsMedical educationPedagogyUrology

Identifiers

PMID40338279
PMCPMC12062111

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.