ArticleJournal of clinical sleep medicine : JCSM : official publication of the American Academy of Sleep Medicine2023
Evaluating ChatGPT responses on obstructive sleep apnea for patient education.
Article in Journal of clinical sleep medicine : JCSM : official publication of the American Academy of Sleep Medicine, 2023. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 41 papers, 1 of them a synthesis that pooled it.
What it found
Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.
The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.
The trial behind it
Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.
Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.
Who cites it
41 citing papers in PubMed, 1 synthesis or guideline pooled it.
- Large Language Models for Chatbot Health Advice Studies: A Systematic Review.JAMA network open · 2025Pooled it
- Human-Centered AI in Sleep Health Management: Scoping Review of Stakeholder Perspectives and Co-Design Practices.Journal of medical Internet research · 2026Article
- Large Language Model-Assisted Shared Decision-Making (SDM) in Rhinology: A Randomized Controlled Pilot Study.Laryngoscope investigative otolaryngology · 2026Article
- Assessing AI-generated smoking cessation advice for patient education in primary care.BMC primary care · 2026Article
- Assessing ChatGPT Responses to Commonly Asked Questions About Hypoglossal Nerve Stimulation.World journal of otorhinolaryngology - head and neck surgery · 2026Article
- Comparative Quality Assessment of Artificial Intelligence in Patient Education on Platelet-Rich Plasma (PRP) Therapy.Journal of personalized medicine · 2026Article
- Utility of ChatGPT in generating accurate client handouts for common veterinary internal medicine diseases.Journal of veterinary internal medicine · 2026Article
- Evaluating the Accuracy, Usefulness, and Safety of ChatGPT for Caregivers Seeking Information on Congenital Muscular Torticollis.Healthcare (Basel, Switzerland) · 2026Article
- Efficacy of Large Language Models in Providing Evidence-Based Patient Education for Celiac Disease: A Comparative Analysis.Nutrients · 2025Article
- A Scoping Review of Large Language Models in Personal Sleep Wellness.Mayo Clinic proceedings. Digital health · 2025Review
- Artificial Intelligence in Patient Education for Androgenetic Alopecia: A Comparative Study of ChatGPT, Gemini, and Deepseek R1.Dermatology practical & conceptual · 2025Article
- Augmenting Patient Education in Hand Surgery-Evaluation of ChatGPT as an Informational Tool in Carpal Tunnel Syndrome.Medicina (Kaunas, Lithuania) · 2025Article
- Evaluating the Quality and Understandability of Radiology Report Summaries Generated by ChatGPT: Survey Study.JMIR formative research · 2025Article
- Artificial Intelligence in Peripheral Artery Disease Education: A Battle Between ChatGPT and Google Gemini.Cureus · 2025Article
- Understanding Large Language Models in Healthcare: A Guide to Clinical Implementation and Interpreting Publications.Cureus · 2025Review
- Online Health Information-Seeking in the Era of Large Language Models: Cross-Sectional Web-Based Survey Study.Journal of medical Internet research · 2025Article
- Chasing sleep physicians: ChatGPT-4o on the interpretation of polysomnographic results.European archives of oto-rhino-laryngology : official journal of the European Federation of Oto-Rhino-Laryngological Societies (EUFOS) : affiliated with the German Society for Oto-Rhino-Laryngology - Head and Neck Surgery · 2025Article
- Assessing ChatGPT's Capability in Addressing Thyroid Cancer Patient Queries: A Comprehensive Mixed-Methods Evaluation.Journal of the Endocrine Society · 2025Article
- Exploring the Potentials of Artificial Intelligence in Sepsis Management in the Intensive Care Unit.Critical care research and practice · 2025Review
- Evaluating Locally Run Large Language Models for Obstructive Sleep Apnea Diagnosis and Treatment: A Real-World Polysomnography Study.Nature and science of sleep · 2025Article
Corrections and comments
PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.
Authors and funding
6 authors.
Funding
No grant is acknowledged in the PubMed record.
Abstract
STUDY
objectivesWe evaluated the quality of ChatGPT responses to questions on obstructive sleep apnea for patient education and assessed how prompting the chatbot influences correctness, estimated grade level, and references of answers.
methodsChatGPT was queried 4 times with 24 identical questions. Queries differed by initial prompting: no prompting, patient-friendly prompting, physician-level prompting, and prompting for statistics/references. Answers were scored on a hierarchical scale: incorrect, partially correct, correct, correct with either statistic or referenced citation ("correct+"), or correct with both a statistic and citation ("perfect"). Flesch-Kincaid grade level and citation publication years were recorded for answers. Proportions of responses at incremental score thresholds were compared by prompt type using chi-squared analysis. The relationship between prompt type and grade level was assessed using analysis of variance.
resultsAcross all prompts (n = 96 questions), 69 answers (71.9%) were at least correct. Proportions of responses that were at least partially correct (
conclusionsChatGPT overall provides appropriate answers to most questions on obstructive sleep apnea regardless of prompting. While prompting decreases response grade level, all responses remained above accepted recommendations for presenting medical information to patients. Given ChatGPT's rapid implementation, sleep experts may seek to further scrutinize its medical literacy and utility for patients. CITATION: Campbell DJ, Estephan LE, Mastrolonardo EV, Amin DR, Huntley CT, Boon MS. Evaluating ChatGPT responses on obstructive sleep apnea for patient education.
Indexed as
Identifiers
What OpenQuestion holds
Registered trials
Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.