Evidence map›Paper›PMID 41939087›Full record

ArticleAdvances in medical education and practice2026

Comparative Impact of ChatGPT and Conventional Search Tools on Clinical Reasoning Performance: A Randomized Crossover Study in Preclinical Medical Students.

Adisak Nartthanarung, Komson Plangsiri, Pinkawas Kongmalai

Abstract read
In one paragraph

Article in Advances in medical education and practice, 2026. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 4 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
4citing papers in PubMed, 1 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

4 citing papers in PubMed, 1 synthesis or guideline pooled it.

  1. Pooled it
  2. Article
  3. Review
  4. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

3 authors.

Adisak NartthanarungDepartment of Orthopedics, Faculty of Medicine, Kasetsart University, Bangkok, Thailand.
Komson PlangsiriDepartment of Orthopaedics, Faculty of Medicine, Srinakharinwirot University, Nakhon Nayok, Thailand.
Pinkawas KongmalaiDepartment of Orthopedics, Faculty of Medicine, Kasetsart University, Bangkok, Thailand.ORCID 0000-0003-3397-6600

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

Purpose: To compare the impact of ChatGPT and conventional search strategies on clinical reasoning performance among preclinical medical students. Patients and Methods: A randomized crossover study was conducted at a single institution during a musculoskeletal system course involving 46 second-year medical students. Participants completed a baseline pre-test followed by two structured intervention phases in which they analyzed standardized clinical cases using either ChatGPT or conventional search tools (Google or PubMed). A 60-minute washout period was implemented before crossover to the alternate modality. Post-tests were administered after each phase. The primary outcome was clinical reasoning performance measured using an eight-point rubric-based scale. Secondary outcomes included self-perceived learning, confidence, and qualitative feedback. Paired t-tests were used for within-subject comparisons, and effect sizes were calculated using Cohen's d. Results: The mean pre-test score was 3.96 (standard deviation 1.65), increasing to 4.96 (standard deviation 1.71) after the first intervention and to 5.70 (standard deviation 1.50) after crossover. Improvements were statistically significant across all paired comparisons (p < 0.05), with a large cumulative effect size (Cohen's d = 0.97). Performance improvements were observed across both learning modalities, without evidence that gains were attributable to a single approach. Students reported that ChatGPT facilitated rapid organization of differential diagnoses and management plans, whereas conventional search encouraged more deliberate synthesis and comparison of information sources. Conclusion: Both artificial intelligence-assisted and conventional search strategies improved short-term clinical reasoning performance within a structured active-learning environment. These findings support a balanced integration of large language models alongside traditional search methods in undergraduate medical education. Clinical Trial Registration Number: TCTR20260218005.

Indexed as

active learningcrossover study designinformation-seeking behaviorlarge language modelsmedical educationundergraduate curriculum

Identifiers

PMID41939087
PMCPMC13048059

What OpenQuestion holds

Textmetadata
LicenceCC BY-NC
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.