Evidence map›Paper›PMID 39649918›Full record

ArticleAnnals of medicine and surgery (2012)2024

Exploring ChatGPT in clinical inquiry: a scoping review of characteristics, applications, challenges, and evaluation.

Shahabeddin Abhari, Yasna Afshari, Farhad Fatehi, Hosna Salmani, Ali Garavand, Dmytro Chumachenko, Somayyeh Zakerabasali, Plinio P Morita

Abstract readScoping Review
In one paragraph

Article in Annals of medicine and surgery (2012), 2024. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 4 papers.

0numbers the graph read from it
0cells of the map it votes in
4citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

4 citing papers in PubMed.

  1. Article
  2. Review
  3. Review
  4. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

8 authors.

Shahabeddin AbhariSchool of Public Health Sciences, University of Waterloo, Waterloo, Ontario, Canada.
Yasna AfshariDepartment of Radiology and Nuclear Medicine, Erasmus MC University Medical Center Rotterdam, Rotterdam.
Farhad FatehiBusiness School, The University of Queensland, Brisbane, Australia.
Hosna SalmaniDepartment of Health Information Management, School of Health Management and Information Sciences, Iran University of Medical Sciences, Tehran, Iran.ORCID https://orcid.org/0000-0001-8403-6673
Ali GaravandDepartment of Health Information Technology, School of Allied Medical Sciences, Lorestan University of Medical Sciences, Khorramabad, Iran.
Dmytro ChumachenkoDepartment of Mathematical Modeling and Artificial Intelligence, National Aerospace University 'Kharkiv Aviation Institute', Kharkiv, Ukraine.
Somayyeh ZakerabasaliDepartment of Health Information Management, Clinical Education Research Center, Health Human Resources Research Center, School of Health Management and Information Sciences, Shiraz University of Medical Sciences, Shiraz, Iran.
Plinio P MoritaSchool of Public Health Sciences, University of Waterloo, Waterloo, Ontario, Canada.

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

Introduction: Recent advancements in generative AI, exemplified by ChatGPT, hold promise for healthcare applications such as decision-making support, education, and patient engagement. However, rigorous evaluation is crucial to ensure reliability and safety in clinical contexts. This scoping review explores ChatGPT's role in clinical inquiry, focusing on its characteristics, applications, challenges, and evaluation. Methods: This review, conducted in 2023, followed PRISMA-ScR guidelines (Supplemental Digital Content 1, http://links.lww.com/MS9/A636). Searches were performed across PubMed, Scopus, IEEE, Web of Science, Cochrane, and Google Scholar using relevant keywords. The review explored ChatGPT's effectiveness in various medical domains, evaluation methods, target users, and comparisons with other AI models. Data synthesis and analysis incorporated both quantitative and qualitative approaches. Results: Analysis of 41 academic studies highlights ChatGPT's potential in medical education, patient care, and decision support, though performance varies by medical specialty and linguistic context. GPT-3.5, frequently referenced in 26 studies, demonstrated adaptability across diverse scenarios. Challenges include limited access to official answer keys and inconsistent performance, underscoring the need for ongoing refinement. Evaluation methods, including expert comparisons and statistical analyses, provided significant insights into ChatGPT's efficacy. The identification of target users, such as medical educators and nonexpert clinicians, illustrates its broad applicability. Conclusion: ChatGPT shows significant potential in enhancing clinical practice and medical education. Nevertheless, continuous refinement is essential for its successful integration into healthcare, aiming to improve patient care outcomes, and address the evolving needs of the medical community.

Indexed as

artificial intelligenceChatGPTclinical questionsgenerative AIhealthcare

Identifiers

PMID39649918
PMCPMC11623824

What OpenQuestion holds

Textmetadata
LicenceCC BY-NC-ND
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.