Evidence map›Paper›PMID 38623218›Full record

ArticleHeliyon2024

ChatGPT-3.5 System Usability Scale early assessment among Healthcare Workers: Horizons of adoption in medical practice.

Fadi Aljamaan, Khalid H Malki, Khalid Alhasan, Amr Jamal, Ibraheem Altamimi, Afnan Khayat, Ali Alhaboob, Naif Abdulmajeed, Fatimah S Alshahrani, Khaled Saad and 3 more

Open access · goldAbstract read
In one paragraph

Article in Heliyon, 2024. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 10 papers.

0numbers the graph read from it
0cells of the map it votes in
10citing papers in PubMed
2.0field-weighted citation impact, top 13% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

10 citing papers in PubMed, 17 citations in OpenAlex.

  1. Article
  2. Article
  3. Article
  4. Article
  5. Article
  6. Article
  7. Article
  8. Article
  9. Article
  10. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

13 authors at 5 institutions in 3 countries.

Fadi AljamaanCollege of Medicine, King Saud University, Riyadh 11362, Saudi Arabia.
Khalid H MalkiResearch Chair of Voice, Swallowing, and Communication Disorders, Department of Otolaryngology, College of Medicine, King Saud University, Riyadh 11362, Saudi Arabia.
Khalid AlhasanCollege of Medicine, King Saud University, Riyadh 11362, Saudi Arabia.
Amr JamalCollege of Medicine, King Saud University, Riyadh 11362, Saudi Arabia.
Ibraheem AltamimiCollege of Medicine, King Saud University, Riyadh 11362, Saudi Arabia.
Afnan KhayatHealth Information Management Department, Prince Sultan Military College of Health Sciences, Al Dhahran 34313, Saudi Arabia.
Ali AlhaboobCollege of Medicine, King Saud University, Riyadh 11362, Saudi Arabia.
Naif AbdulmajeedPediatric Department, College of Medicine, King Saud University Medical City, Riyadh 11362, Saudi Arabia.
Fatimah S AlshahraniCollege of Medicine, King Saud University, Riyadh 11362, Saudi Arabia.
Khaled SaadPediatric Department, Faculty of Medicine, Assiut University, Assiut 71516, Egypt.
Ayman Al-EyadhyCollege of Medicine, King Saud University, Riyadh 11362, Saudi Arabia.
Jaffar A Al-TawfiqSpecialty Internal Medicine and Quality Department, Johns Hopkins Aramco Healthcare, Dhahran 34465, Saudi Arabia.
Mohamad-Hani TemsahCollege of Medicine, King Saud University, Riyadh 11362, Saudi Arabia.
King Saud Medical City · SAKing Saud University · SAAssiut University · EGJohns Hopkins University · USRiyadh Armed Forces Hospital · SA

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

Artificial intelligence (AI) chatbots, such as ChatGPT, have widely invaded all domains of human life. They have the potential to transform healthcare future. However, their effective implementation hinges on healthcare workers' (HCWs) adoption and perceptions. This study aimed to evaluate HCWs usability of ChatGPT three months post-launch in Saudi Arabia using the System Usability Scale (SUS). A total of 194 HCWs participated in the survey. Forty-seven percent were satisfied with their usage, 57 % expressed moderate to high trust in its ability to generate medical decisions. 58 % expected ChatGPT would improve patients' outcomes, even though 84 % were optimistic of its potential to improve the future of healthcare practice. They expressed possible concerns like recommending harmful medical decisions and medicolegal implications. The overall mean SUS score was 64.52, equivalent to 50 % percentile rank, indicating high marginal acceptability of the system. The strongest positive predictors of high SUS scores were participants' belief in AI chatbot's benefits in medical research, self-rated familiarity with ChatGPT and self-rated computer skills proficiency. Participants' learnability and ease of use score correlated positively but weakly. On the other hand, medical students and interns had significantly high learnability scores compared to others, while ease of use scores correlated very strongly with participants' perception of positive impact of ChatGPT on the future of healthcare practice. Our findings highlight the HCWs' perceived marginal acceptance of ChatGPT at the current stage and their optimism of its potential in supporting them in future practice, especially in the research domain, in addition to humble ambition of its potential to improve patients' outcomes particularly in regard of medical decisions. On the other end, it underscores the need for ongoing efforts to build trust and address ethical and legal concerns of AI implications in healthcare. The study contributes to the growing body of literature on AI chatbots in healthcare, especially addressing its future improvement strategies and provides insights for policymakers and healthcare providers about the potential benefits and challenges of implementing them in their practice.

Indexed as

AI in healthcareArtificial IntelligenceChatbots in medical practiceChatGPTDigital healthHealthcare technologyHealthcare workers usabilitySaudi ArabiaSystem Usability Scale

Identifiers

PMID38623218
PMCPMC11016609
OpenAlexW4394063609

What OpenQuestion holds

Textmetadata
LicenceCC BY-NC-ND
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.