Evidence map›Paper›PMID 31825499›Full record

Trial reportJAMA network open2019

Effectiveness of a Hospital-Based Computerized Decision Support System on Clinician Recommendations and Patient Outcomes: A Randomized Clinical Trial.

Lorenzo Moja, Hernan Polo Friz, Matteo Capobussi, Koren Kwag, Rita Banzi, Francesca Ruggiero, Marien González-Lorenzo, Elisa G Liberati, Massimo Mangia, Peter Nyberg and 6 more

Registry-linked trialAbstract readRandomized Controlled Trial
In one paragraph

Trial report in JAMA network open, 2019. The graph could read no effect estimate from its abstract, so it casts no vote on the map. It is linked to trial NCT02577198 (Implementing an Evidence-based Computerized Decision Support System Linked to Electronic Health Records to Improve Patient Care in a General Hospital), which is not on this map. Cited by 25 papers, 4 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
25citing papers in PubMed, 4 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

NCT02577198 nacompletednot on this map

Implementing an Evidence-based Computerized Decision Support System Linked to Electronic Health Records to Improve Patient Care in a General Hospital

TypeinterventionalSponsorI.R.C.C.S Ospedale Galeazzi-Sant'AmbrogioRan2015 to 2017Enrolled6,479ConditionsPhysician's RoleArmsMedilogy Decision Support System (MediDSS)
3 · Its place in the literature

Who cites it

25 citing papers in PubMed, 4 syntheses or guidelines pooled it.

  1. Pooled it
  2. Effect of electronic drug-drug interaction alerts on patient and clinician outcomes: a systematic review.Journal of the American Medical Informatics Association : JAMIA · 2025
    Pooled it
  3. Pooled it
  4. Pooled it
  5. Clinical Decision Support with or without Shared Decision Making to Improve Preventive Cancer Care: A Cluster-Randomized Trial.Medical decision making : an international journal of the Society for Medical Decision Making · 2022
    Trial
  6. Article
  7. Article
  8. Article
  9. Article
  10. Review
  11. Article
  12. Evaluation of an electronic health record Drug Interaction Customization Editor (DICE).American journal of health-system pharmacy : AJHP : official journal of the American Society of Health-System Pharmacists · 2024
    Article
  13. Article
  14. Article
  15. Review
  16. Article
  17. Review
  18. Article
  19. Review
  20. Review
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

16 authors.

Lorenzo MojaDepartment of Biomedical Sciences for Health, University of Milan, Milan, Italy.
Hernan Polo FrizInternal Medicine Division, Medical Department, Vimercate Hospital, Vimercate, Italy.
Matteo CapobussiClinical Epidemiology Unit, Istituto di Ricovero e Cura a Carattere Scientifico (IRCCS) Orthopedic Institute Galeazzi, Milan, Italy.
Koren KwagMedical School of International Health, Ben Gurion University of the Negev, Beer Sheva, Israel.
Rita BanziIRCCS Mario Negri Institute for Pharmacological Research, Milan, Italy.
Francesca RuggieroDepartment of Biomedical Sciences for Health, University of Milan, Milan, Italy.
Marien González-LorenzoHumanitas Clinical and Research Center, Milan, Italy.
Elisa G LiberatiThe Healthcare Improvement Studies Institute, University of Cambridge, Cambridge, United Kingdom.
Massimo MangiaMedilogy Srl, Milan, Italy.
Peter NybergDuodecim Medical Publications Ltd, Helsinki, Finland.
Ilkka KunnamoDuodecim Medical Publications Ltd, Helsinki, Finland.
Claudio CimminielloInternal Medicine Division, Medical Department, Vimercate Hospital, Vimercate, Italy.
Giuseppe VighiInternal Medicine Division, Medical Department, Vimercate Hospital, Vimercate, Italy.
Jeremy M GrimshawClinical Epidemiology Program, Ottawa Hospital Research Institute and the Department of Medicine, University of Ottawa, Ottawa, Ontario, Canada.
Giovanni DelgrossiInternal Medicine Division, Medical Department, Vimercate Hospital, Vimercate, Italy.
Stefanos BonovasHumanitas Clinical and Research Center, Milan, Italy.

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

Importance: Sophisticated evidence-based information resources can filter medical evidence from the literature, integrate it into electronic health records, and generate recommendations tailored to individual patients. Objective: To assess the effectiveness of a computerized clinical decision support system (CDSS) that preappraises evidence and provides health professionals with actionable, patient-specific recommendations at the point of care. Design, Setting, and Participants: Open-label, parallel-group, randomized clinical trial among internal medicine wards of a large Italian general hospital. All analyses in this randomized clinical trial followed the intent-to-treat principle. Between November 1, 2015, and December 31, 2016, patients were randomly assigned to the intervention group, in which CDSS-generated reminders were displayed to physicians, or to the control group, in which reminders were generated but not shown. Data were analyzed between February 1 and July 31, 2018. Interventions: Evidence-Based Medicine Electronic Decision Support (EBMEDS), a commercial CDSS covering a wide array of health conditions across specialties, was integrated into the hospital electronic health records to generate patient-specific recommendations. Main Outcomes and Measures: The primary outcome was the resolution rate, the rate at which medical problems identified and alerted by the CDSS were addressed by a change in practice. Secondary outcomes included the length of hospital stay and in-hospital all-cause mortality. Results: In this randomized clinical trial, 20 563 patients were admitted to the hospital. Of these, 6480 (31.5%) were admitted to the internal medicine wards (study population) and randomized (3242 to CDSS and 3238 to control). The mean (SD) age of patients was 70.5 (17.3) years, and 54.5% were men. In total, 28 394 reminders were generated throughout the course of the trial (median, 3 reminders per patient per hospital stay; interquartile range [IQR], 1-6). These messages led to a change in practice in approximately 4 of 100 patients. The resolution rate was 38.0% (95% CI, 37.2%-38.8%) in the intervention group and 33.7% (95% CI, 32.9%-34.4%) in the control group, corresponding to an odds ratio of 1.21 (95% CI, 1.11-1.32; P < .001). The length of hospital stay did not differ between the groups, with a median time of 8 days (IQR, 5-13 days) for the intervention group and a median time of 8 days (IQR, 5-14 days) for the control group (P = .36). In-hospital all-cause mortality also did not differ between groups (odds ratio, 0.95; 95% CI, 0.77-1.17; P = .59). Alert fatigue did not differ between early and late study periods. Conclusions and Relevance: An international commercial CDSS intervention marginally influenced routine practice in a general hospital, although the change did not statistically significantly affect patient outcomes. Trial Registration: ClinicalTrials.gov identifier: NCT02577198.

Indexed as

Decision Support Systems, ClinicalHospital Information SystemsAgedElectronic Health RecordsEvidence-Based MedicineFemaleHospital MortalityHospitals, GeneralHumansItalyLength of StayMaleMiddle AgedOutcome Assessment, Health CarePractice Patterns, Physicians'Precision Medicine

Identifiers

PMID31825499
PMCPMC6991299

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.