Evidence map›Paper›PMID 39290765›Full record

ReviewArchives of academic emergency medicine2024

Diagnostic Accuracy of ChatGPT for Patients' Triage; a Systematic Review and Meta-Analysis.

Navid Kaboudi, Saeedeh Firouzbakht, Mohammad Shahir Eftekhar, Fatemeh Fayazbakhsh, Niloufar Joharivarnoosfaderani, Salar Ghaderi, Mohammadreza Dehdashti, Yasmin Mohtasham Kia, Maryam Afshari, Maryam Vasaghi-Gharamaleki and 6 more

Abstract readReview
In one paragraph

Review in Archives of academic emergency medicine, 2024. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 25 papers, 3 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
25citing papers in PubMed, 3 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

25 citing papers in PubMed, 3 syntheses or guidelines pooled it.

  1. Pooled it
  2. Pooled it
  3. Pooled it
  4. Article
  5. Review
  6. Article
  7. Article
  8. Article
  9. Article
  10. Article
  11. Article
  12. Article
  13. Article
  14. Article
  15. Observational
  16. Article
  17. Review
  18. Article
  19. Article
  20. Review
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

16 authors.

Navid KaboudiFaculty of Pharmacy, Tabriz University of Medical Sciences, Tabriz, Iran.
Saeedeh FirouzbakhtDepartment of Pediatrics, School of Medicine, Bushehr University of Medical Sciences, Bushehr, Iran.
Mohammad Shahir EftekharDepartment of Surgery, School of Medicine, Qom University of Medical Sciences, Qom, Iran.
Fatemeh FayazbakhshSchool of Medicine, Birjand University of Medical Sciences, Birjand, iran.
Niloufar JoharivarnoosfaderaniFaculty of Medicine, Tehran University of Medical Sciences, Tehran, Iran.
Salar GhaderiResearch Center for Evidence-based Medicine, Faculty of Medicine, Tabriz University of Medical Sciences, Tabriz, Iran.
Mohammadreza DehdashtiSchool of Medicine, Bushehr University of Medical Sciences, Bushehr, Iran.
Yasmin Mohtasham KiaSchool of Medicine, Iran University of Medical Sciences, Tehran, Iran.
Maryam AfshariSchool of Medicine, Shiraz University of Medical Sciences, Shiraz, Iran.
Maryam Vasaghi-GharamalekiClinical Neurology Research Center, Shiraz University of Medical Sciences, Shiraz, Iran.
Leila HaghaniMemorial Sloan Kettering Cancer Center, New York, United States.
Zahra MoradzadehSchool of Medicine, Tabriz University of Medical Sciences, Tabriz, Iran.
Fattaneh KhalajLiver and Pancreatobiliary Diseases Research Center, Digestive Diseases Research Institute, Tehran University of Medical Sciences, Tehran, IR, Iran.
Zahra MohammadiSchool of Medicine, Tabriz University of Medical Sciences, Tabriz, Iran.
Zahra HasanabadiSchool of Medicine, Qazvin University of Medical Sciences, Qazvin, Iran.
Ramin ShahidiSchool of Medicine, Bushehr University of Medical Sciences, Bushehr, Iran.

Funding

X-RAY CRYSTALLOGRAPHYP30CA008748 · NCI · SLOAN-KETTERING INSTITUTE FOR CANCER RES · PI Nicholas D Socci · 1985 to 2026
$347.4M
NCI NIH HHS P30 CA008748
6 · The paper itself

Abstract

Introduction: Artificial intelligence (AI), particularly ChatGPT developed by OpenAI, has shown the potential to improve diagnostic accuracy and efficiency in emergency department (ED) triage. This study aims to evaluate the diagnostic performance and safety of ChatGPT in prioritizing patients based on urgency in ED settings. Methods: A systematic review and meta-analysis were conducted following PRISMA guidelines. Comprehensive literature searches were performed in Scopus, Web of Science, PubMed, and Embase. Studies evaluating ChatGPT's diagnostic performance in ED triage were included. Quality assessment was conducted using the QUADAS-2 tool. Pooled accuracy estimates were calculated using a random-effects model, and heterogeneity was assessed with the I² statistic. Results: Fourteen studies with a total of 1,412 patients or scenarios were included. ChatGPT 4.0 demonstrated a pooled accuracy of 0.86 (95% CI: 0.64-0.98) with substantial heterogeneity (I² = 93%). ChatGPT 3.5 showed a pooled accuracy of 0.63 (95% CI: 0.43-0.81) with significant heterogeneity (I² = 84%). Funnel plots indicated potential publication bias, particularly for ChatGPT 3.5. Quality assessments revealed varying levels of risk of bias and applicability concerns. Conclusion: ChatGPT, especially version 4.0, shows promise in improving ED triage accuracy. However, significant variability and potential biases highlight the need for further evaluation and enhancement.

Indexed as

ChatGPTdiagnostic performanceemergency departmenttriage

Identifiers

PMID39290765
PMCPMC11407534

What OpenQuestion holds

Textmetadata
LicenceCC BY-NC
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.