ArticleJournal of medical systems2023
"ChatGPT, Can You Help Me Save My Child's Life?" - Diagnostic Accuracy and Supportive Capabilities to Lay Rescuers by ChatGPT in Prehospital Basic Life Support and Paediatric Advanced Life Support Cases - An In-silico Analysis.
Article in Journal of medical systems, 2023. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 22 papers, 2 of them syntheses that pooled it.
What it found
Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.
The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.
The trial behind it
Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.
Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.
Who cites it
22 citing papers in PubMed, 2 syntheses or guidelines pooled it.
- Large Language Models in Cardiology: Systematic Review.JMIR cardio · 2026Pooled it
- Unveiling the Potential of Large Language Models in Transforming Chronic Disease Management: Mixed Methods Systematic Review.Journal of medical Internet research · 2025Pooled it
- Can large language models provide quality, reliable and readable information about sudden infant death syndrome?BMC pediatrics · 2026Article
- Comparing Chinese-language large language models for caregiver questions about developmental dysplasia of the hip.Frontiers in pediatrics · 2026Article
- Mapping applications and evaluations of LLM-enabled AI chatbots for health purposes: a scoping review.Frontiers in public health · 2026Article
- Article
- Large Language Models in Critical Care Medicine: Scoping Review.JMIR medical informatics · 2025Article
- Article
- Artificial Intelligence Chatbots in Pediatric Emergencies: A Reliable Lifeline or a Risk?Cureus · 2025Article
- Can AI match emergency physicians in managing common emergency cases? A comparative performance evaluation.BMC emergency medicine · 2025Article
- A large language model based pipeline for extracting information from patient complaint and anamnesis in clinical notes for severity assessment.Scientific reports · 2025Article
- Large language models for structured reporting in radiology: past, present, and future.European radiology · 2025Review
- Parental Perception on Usage of AI Chatbot to Understand Paediatric Otorhinolaryngology Condition: A Survey.Indian journal of otolaryngology and head and neck surgery : official publication of the Association of Otolaryngologists of India · 2025Article
- Evaluation of correctness and reliability of GPT, Bard, and Bing chatbots' responses in basic life support scenarios.Scientific reports · 2025Article
- A systematic review and meta-analysis of diagnostic performance comparison between generative AI and physicians.NPJ digital medicine · 2025Article
- Current applications and challenges in large language models for patient care: a systematic review.Communications medicine · 2025Article
- Accuracy of Prospective Assessments of 4 Large Language Model Chatbot Responses to Patient Questions About Emergency Care: Experimental Comparative Study.Journal of medical Internet research · 2024Article
- The Role of Large Language Models in Transforming Emergency Medicine: Scoping Review.JMIR medical informatics · 2024Article
- ChatGPT for Parents of Children Seeking Emergency Care - so much Hope, so much Caution.Journal of medical systems · 2024Article
- Microsoft Bing outperforms five other generative artificial intelligence chatbots in the Antwerp University multiple choice medical license exam.PLOS digital health · 2024Article
Corrections and comments
- Commented on by
Authors and funding
8 authors.
Funding
No grant is acknowledged in the PubMed record.
Abstract
backgroundPaediatric emergencies are challenging for healthcare workers, first aiders, and parents waiting for emergency medical services to arrive. With the expected rise of virtual assistants, people will likely seek help from such digital AI tools, especially in regions lacking emergency medical services. Large Language Models like ChatGPT proved effective in providing health-related information and are competent in medical exams but are questioned regarding patient safety. Currently, there is no information on ChatGPT's performance in supporting parents in paediatric emergencies requiring help from emergency medical services. This study aimed to test 20 paediatric and two basic life support case vignettes for ChatGPT and GPT-4 performance and safety in children.
methodsWe provided the cases three times each to two models, ChatGPT and GPT-4, and assessed the diagnostic accuracy, emergency call advice, and the validity of advice given to parents.
resultsBoth models recognized the emergency in the cases, except for septic shock and pulmonary embolism, and identified the correct diagnosis in 94%. However, ChatGPT/GPT-4 reliably advised to call emergency services only in 12 of 22 cases (54%), gave correct first aid instructions in 9 cases (45%) and incorrectly advised advanced life support techniques to parents in 3 of 22 cases (13.6%).
conclusionConsidering these results of the recent ChatGPT versions, the validity, reliability and thus safety of ChatGPT/GPT-4 as an emergency support tool is questionable. However, whether humans would perform better in the same situation is uncertain. Moreover, other studies have shown that human emergency call operators are also inaccurate, partly with worse performance than ChatGPT/GPT-4 in our study. However, one of the main limitations of the study is that we used prototypical cases, and the management may differ from urban to rural areas and between different countries, indicating the need for further evaluation of the context sensitivity and adaptability of the model. Nevertheless, ChatGPT and the new versions under development may be promising tools for assisting lay first responders, operators, and professionals in diagnosing a paediatric emergency.
trial registrationNot applicable.
Indexed as
Identifiers
What OpenQuestion holds
Registered trials
Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.