Evidence map›Paper›PMID 39015552›Full record

ArticleLaryngoscope investigative otolaryngology2024

TrachGPT: Appraisal of tracheostomy care recommendations from an artificial intelligent Chatbot.

Oluwatobiloba Ayo-Ajibola, Ryan J Davis, Matthew E Lin, Neelaysh Vukkadala, Karla O'Dell, Mark S Swanson, Michael M Johns, Elizabeth A Shuman

Abstract read
In one paragraph

Article in Laryngoscope investigative otolaryngology, 2024. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 3 papers.

0numbers the graph read from it
0cells of the map it votes in
3citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

3 citing papers in PubMed.

  1. Article
  2. Article
  3. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

8 authors.

Oluwatobiloba Ayo-AjibolaKeck School of Medicine of the University of Southern California Los Angeles California USA.ORCID https://orcid.org/0009-0002-4824-7160
Ryan J DavisKeck School of Medicine of the University of Southern California Los Angeles California USA.ORCID https://orcid.org/0009-0002-0408-8380
Matthew E LinDepartment of Head and Neck Surgery University of California Los Angeles Los Angeles California USA.ORCID https://orcid.org/0000-0001-9914-9670
Neelaysh VukkadalaDepartment of Head and Neck Surgery University of California Los Angeles Los Angeles California USA.
Karla O'DellDepartment of Otolaryngology-Head and Neck Surgery University of Southern California Caruso Los Angeles California USA.
Mark S SwansonDepartment of Otolaryngology-Head and Neck Surgery University of Southern California Caruso Los Angeles California USA.
Michael M JohnsDepartment of Otolaryngology-Head and Neck Surgery University of Southern California Caruso Los Angeles California USA.
Elizabeth A ShumanDepartment of Otolaryngology-Head and Neck Surgery University of Southern California Caruso Los Angeles California USA.ORCID https://orcid.org/0009-0009-0872-869X

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

Objective: Safe home tracheostomy care requires engagement and troubleshooting by patients, who may turn to online, AI-generated information sources. This study assessed the quality of ChatGPT responses to such queries. Methods: In this cross-sectional study, ChatGPT was prompted with 10 hypothetical tracheostomy care questions in three domains (complication management, self-care advice, and lifestyle adjustment). Responses were graded by four otolaryngologists for appropriateness, accuracy, and overall score. The readability of responses was evaluated using the Flesch Reading Ease (FRE) and Flesch-Kincaid Reading Grade Level (FKRGL). Descriptive statistics and ANOVA testing were performed with statistical significance set to Results: On a scale of 1-5, with 5 representing the greatest appropriateness or overall score and a 4-point scale with 4 representing the highest accuracy, the responses exhibited moderately high appropriateness (mean = 4.10, SD = 0.90), high accuracy (mean = 3.55, SD = 0.50), and moderately high overall scores (mean = 4.02, SD = 0.86). Scoring between response categories (self-care recommendations, complication recommendations, lifestyle adjustments, and special device considerations) revealed no significant scoring differences. Suboptimal responses lacked nuance and contained incorrect information and recommendations. Readability indicated college and advanced levels for FRE (Mean = 39.5, SD = 7.17) and FKRGL (Mean = 13.1, SD = 1.47), higher than the sixth-grade level recommended for patient-targeted resources by the NIH. Conclusion: While ChatGPT-generated tracheostomy care responses may exhibit acceptable appropriateness, incomplete or misleading information may have dire clinical consequences. Further, inappropriately high reading levels may limit patient comprehension and accessibility. At this point in its technological infancy, AI-generated information should not be solely relied upon as a direct patient care resource.

Indexed as

artificial intelligenceeducationhead and neck cancerpatient knowledgetracheostomy

Identifiers

PMID39015552
PMCPMC11250132

What OpenQuestion holds

Textmetadata
LicenceCC BY-NC-ND
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.