Evidence map›Paper›PMID 38568227›Full record

ArticleJournal of neurology2024

ChatGPT vs. neurologists: a cross-sectional study investigating preference, satisfaction ratings and perceived empathy in responses among people living with multiple sclerosis.

Elisabetta Maida, Marcello Moccia, Raffaele Palladino, Giovanna Borriello, Giuseppina Affinito, Marinella Clerico, Anna Maria Repice, Alessia Di Sapio, Rosa Iodice, Antonio Luca Spiezia and 40 more

Abstract read
In one paragraph

Article in Journal of neurology, 2024. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 28 papers, 2 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
28citing papers in PubMed, 2 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

28 citing papers in PubMed, 2 syntheses or guidelines pooled it.

  1. Pooled it
  2. Pooled it
  3. Article
  4. Article
  5. Article
  6. Article
  7. Article
  8. Review
  9. Article
  10. Article
  11. Article
  12. Article
  13. Article
  14. Article
  15. Article
  16. Article
  17. Review
  18. Article
  19. Article
  20. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

50 authors.

Elisabetta Maida *Department of Advanced Medical and Surgical Sciences, University of Campania "Luigi Vanvitelli", Via Pansini 5, 80131, Naples, Italy.
Marcello Moccia *Department of Molecular Medicine and Medical Biotechnology, Federico II University of Naples, Naples, Italy.
Raffaele PalladinoDepartment of Public Health, University "Federico II" of Naples, Naples, Italy.
Giovanna BorrielloDepartment of Human Neuroscience, Sapienza University of Rome, Rome, Italy.
Giuseppina AffinitoDepartment of Public Health, University "Federico II" of Naples, Naples, Italy.
Marinella ClericoDipartimento di Scienze Cliniche e Biologiche, Università Di Torino, Turin, Italy.
Anna Maria RepiceDepartment of Neurology 2 and Tuscan Region Multiple Sclerosis Referral Centre, Careggi University Hospital, Florence, Italy.
Alessia Di SapioDepartment of Neurology and Multiple Sclerosis Regional Referral Centre, AOU San Luigi Gonzaga, Orbassano, Turin, Italy.
Rosa IodiceDepartment of Neurosciences, Reproductive Sciences and Odontostomatology, University of Naples Federico II, Naples, Italy.
Antonio Luca SpieziaMultiple Sclerosis Unit, Policlinico Federico II University Hospital, Naples, Italy.
Maddalena SparacoDepartment of Advanced Medical and Surgical Sciences, University of Campania "Luigi Vanvitelli", Via Pansini 5, 80131, Naples, Italy.
Giuseppina MieleDepartment of Advanced Medical and Surgical Sciences, University of Campania "Luigi Vanvitelli", Via Pansini 5, 80131, Naples, Italy.
Floriana BileDepartment of Advanced Medical and Surgical Sciences, University of Campania "Luigi Vanvitelli", Via Pansini 5, 80131, Naples, Italy.
Cristiano ScandurraDepartment of Neurosciences, Reproductive Sciences and Odontostomatology, University of Naples Federico II, Naples, Italy.
Diana FerraroDepartment of Neuroscience, Azienda Ospedaliero-Universitaria di Modena, Modena, Emilia-Romagna, Italy.
Maria Laura StromilloDepartment of Medicine, Surgery and Neuroscience, University of Siena, Siena, Italy.
Renato DocimoMultiple Sclerosis Center, Department of Advanced Medical and Surgical Sciences, University of Campania "Luigi Vanvitelli", Naples, Italy.
Antonio De MartinoInstitute of Neurology, University Magna Graecia of Catanzaro, Catanzaro, Italy.
Luca MancinelliNeurology Unit, Bufalini Hospital, Local Health Agency of Romagna, Cesena, Italy.
Gianmarco AbbadessaDepartment of Advanced Medical and Surgical Sciences, University of Campania "Luigi Vanvitelli", Via Pansini 5, 80131, Naples, Italy.
Krzysztof SmolikDepartment of Biomedical, Metabolic and Neural Sciences, University of Modena and Reggio Emilia, Modena, Italy.
Lorenzo LorussoNeurology Unit-Neuroscience Department A.S.S.T.Lecco, Merate Hospital, 23807, Merate, Italy.
Maurizio LeoneNeurology Unit, Fondazione IRCCS Casa Sollievo della Sofferenza, 71013, San Giovanni Rotondo, Italy.
Elisa LeveraroDepartment of Neuroscience, Rehabilitation, Ophthalmology, Genetics, Maternal and Child Health (DiNOGMI), University of Genoa, Genoa, Italy.
Francesca LauroDepartment of Neurosciences, Reproductive Sciences and Odontostomatology, University of Naples Federico II, Naples, Italy.
Francesca TrojsiDepartment of Advanced Medical and Surgical Sciences, University of Campania "Luigi Vanvitelli", Via Pansini 5, 80131, Naples, Italy.
Lidia Mislin StreitoDipartimento di Scienze Cliniche e Biologiche, Università Di Torino, Turin, Italy.
Francesca GabrieleDepartment of Biotechnological and Applied Clinical Sciences, University of L'Aquila, L'Aquila, Italy.
Fabiana MarinelliNeurology Unit, Multiple Sclerosis Center, Fabrizio Spaziani Hospital, Frosinone, Italy.
Antonio IannielloDepartment of Human Neuroscience, Sapienza University of Rome, Rome, Italy.
Federica De SantisDepartment of Neurology and Stroke Unit of Avezzano-Sulmona, ASL 1 Avezzano-Sulmona-L'Aquila, L'Aquila, Italy.
Matteo FoschiDepartment of Biotechnological and Applied Clinical Sciences, University of L'Aquila, L'Aquila, Italy.
Nicola De StefanoDepartment of Medicine, Surgery and Neuroscience, University of Siena, Siena, Italy.
Vincenzo Brescia MorraDepartment of Neurosciences, Reproductive Sciences and Odontostomatology, University of Naples Federico II, Naples, Italy.
Alvino BiseccoMultiple Sclerosis Center, Department of Advanced Medical and Surgical Sciences, University of Campania "Luigi Vanvitelli", Naples, Italy.
Giancarlo CogheDepartment of Medical Sciences and Public Health, Multiple Sclerosis Center, Binaghi Hospital, ASL Cagliari, University of Cagliari, Cagliari, Italy.
Eleonora CoccoDepartment of Medical Sciences and Public Health, Multiple Sclerosis Center, Binaghi Hospital, ASL Cagliari, University of Cagliari, Cagliari, Italy.
Michele RomoliNeurology Unit, Bufalini Hospital, Local Health Agency of Romagna, Cesena, Italy.
Francesco CoreaDipartimento di Neurologia, Ospedale di Foligno, Azienda USL Umbria 2, Terni, Italy.
Letizia LeocaniVita-Salute San Raffaele University, Milan, Italy.
Jessica FrauDepartment of Medical Sciences and Public Health, Multiple Sclerosis Center, Binaghi Hospital, ASL Cagliari, University of Cagliari, Cagliari, Italy.
Simona SaccoDepartment of Biotechnological and Applied Clinical Sciences, University of L'Aquila, L'Aquila, Italy.
Matilde IngleseDepartment of Neuroscience, Rehabilitation, Ophthalmology, Genetics, Maternal and Child Health (DiNOGMI), University of Genoa, Genoa, Italy.
Antonio CarotenutoDepartment of Neurosciences, Reproductive Sciences and Odontostomatology, University of Naples Federico II, Naples, Italy.
Roberta LanzilloDepartment of Neurosciences, Reproductive Sciences and Odontostomatology, University of Naples Federico II, Naples, Italy.
Alessandro PadovaniUnit of Neurology, Azienda Socio-Sanitaria Territoriale Spedali Civili, Brescia, Italy.
Maria TriassiDepartment of Public Health, University "Federico II" of Naples, Naples, Italy.
Simona BonavitaDepartment of Advanced Medical and Surgical Sciences, University of Campania "Luigi Vanvitelli", Via Pansini 5, 80131, Naples, Italy. simona.bonavita@unicampania.it.ORCID http://orcid.org/0000-0002-8561-9720
Luigi LavorgnaDepartment of Advanced Medical and Surgical Sciences, University of Campania "Luigi Vanvitelli", Via Pansini 5, 80131, Naples, Italy.
Digital Technologies, Web, Social Media Study Group of the Italian Society of Neurology (SIN)

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

backgroundChatGPT is an open-source natural language processing software that replies to users' queries. We conducted a cross-sectional study to assess people living with Multiple Sclerosis' (PwMS) preferences, satisfaction, and empathy toward two alternate responses to four frequently-asked questions, one authored by a group of neurologists, the other by ChatGPT.

methodsAn online form was sent through digital communication platforms. PwMS were blind to the author of each response and were asked to express their preference for each alternate response to the four questions. The overall satisfaction was assessed using a Likert scale (1-5); the Consultation and Relational Empathy scale was employed to assess perceived empathy.

resultsWe included 1133 PwMS (age, 45.26 ± 11.50 years; females, 68.49%). ChatGPT's responses showed significantly higher empathy scores (Coeff = 1.38; 95% CI = 0.65, 2.11; p > z < 0.01), when compared with neurologists' responses. No association was found between ChatGPT' responses and mean satisfaction (Coeff = 0.03; 95% CI = - 0.01, 0.07; p = 0.157). College graduate, when compared with high school education responder, had significantly lower likelihood to prefer ChatGPT response (IRR = 0.87; 95% CI = 0.79, 0.95; p < 0.01).

conclusionsChatGPT-authored responses provided higher empathy than neurologists. Although AI holds potential, physicians should prepare to interact with increasingly digitized patients and guide them on responsible AI use. Future development should consider tailoring AIs' responses to individual characteristics. Within the progressive digitalization of the population, ChatGPT could emerge as a helpful support in healthcare management rather than an alternative.

Indexed as

Artificial IntelligenceEmpathyMultiple SclerosisNeurologistsAdultCross-Sectional StudiesFemaleHumansMaleMiddle AgedPatient PreferencePatient SatisfactionPersonal SatisfactionPhysician-Patient RelationsArtificial intelligenceLarge language modelMachine learningMultiple sclerosis

Identifiers

PMID38568227
PMCPMC11233331

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.