Evidence map›Paper›PMID 15767266›Full record

SynthesisBMJ (Clinical research ed.)2005

Improving clinical practice using clinical decision support systems: a systematic review of trials to identify features critical to success.

Kensaku Kawamoto, Caitlin A Houlihan, E Andrew Balas, David F Lobach

3 registry-linked trialsAbstract readSystematic Review
In one paragraph

Synthesis in BMJ (Clinical research ed.), 2005. The graph could read no effect estimate from its abstract, so it casts no vote on the map. It is linked to 3 registered trials, which are not on this map. Cited by 1,026 papers, 13 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
1,026citing papers in PubMed, 13 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

NCT04792268 nacompletednot on this mapstarted 2022, after this paper: background citation

Implementation of an Electronic Clinical Decision Support System (eCDSS) for the Early Recognition and Management of Diabetes and Dysglycaemia in Secondary Mental Healthcare : Feasibility Study

TypeinterventionalSponsorKing's College LondonRan2022 to 2023Enrolled4ConditionsSevere Mental Disorder, Diabetes Mellitus, Dysglycemia, Staff AttitudeArmsAccess to eCDSS on wards
NCT06537453 narecruitingnot on this mapstarted 2024, after this paper: background citation

Using Personalized Risk and Digital Tools to Guide Transitions Following Acute Kidney Events - Virtual Care: Virtual Home Hospital With Remote Monitoring to Reduce Acute Care Hospitalization

TypeinterventionalSponsorUniversity of CalgaryRan2024 to 2026Enrolled354ConditionsAcute Kidney InjuryArmsVirtual Care
NCT06931275 narecruitingnot on this mapstarted 2024, after this paper: background citation

Implementing Best Practice Advisories to Reduce Inequities in Technology Use for People With Type 1 Diabetes

TypeinterventionalSponsorT1D Exchange, United StatesRan2024 to 2027Enrolled1,178ConditionsDiabetes Mellitus, Type 1ArmsEMR-based BPA model, Placebo (EMR-based without BPA model)
3 · Its place in the literature

Who cites it

1,026 citing papers in PubMed, 13 syntheses or guidelines pooled it.

  1. Pooled it
  2. Alert fatigue measurement in clinical decision support: a systematic review.Journal of the American Medical Informatics Association : JAMIA · 2026
    Pooled it
  3. Pooled it
  4. Pooled it
  5. Facilitators and Barriers of the Use of Prognostic Models for Clinical Decision Making in Acute Neurologic Care: A Systematic Review.Medical decision making : an international journal of the Society for Medical Decision Making · 2025
    Pooled it
  6. Pooled it
  7. Pooled it
  8. Pooled it
  9. Pooled it
  10. Pooled it
  11. The role of information systems in emergency department decision-making-a literature review.Journal of the American Medical Informatics Association : JAMIA · 2024
    Pooled it
  12. Genetically guided precision medicine clinical decision support tools: a systematic review.Journal of the American Medical Informatics Association : JAMIA · 2024
    Pooled it
  13. Pooled it
  14. Trial
  15. Trial
  16. Trial
  17. Trial
  18. Trial
  19. Trial
  20. Trial

966 more citing papers are in PubMed but not listed here.

4 · The record

Corrections and comments

5 · Who and what money

Authors and funding

4 authors.

Kensaku KawamotoDivision of Clinical Informatics, Department of Community and Family Medicine, Box 2914, Duke University Medical Center, Durham, NC 27710, USA.
Caitlin A Houlihan
E Andrew Balas
David F Lobach

Funding

MEDICAL SCIENTIST TRAINING PROGRAMT32GM007171 · NIGMS · DUKE UNIVERSITY · PI KONTOS, CHRISTOPHER D · 1985 to 2021
$31.2M
Evidence-based design of an XML decision support systemF37LM008161 · NLM · DUKE UNIVERSITY · PI KAWAMOTO, KENSAKU · 2003 to 2005
$140k
POINT OF CARE DELIVERY OF RESEARCH EVIDENCER01HS010472 · AHRQ · UNIVERSITY OF MISSOURI-COLUMBIA · PI BALAS, E. ANDREW · 2000 to 2002
–
EVALUATION OF A GUIDELINE-BASED DECISION SUPPORT SYSTEMR03HS010814 · AHRQ · DUKE UNIVERSITY · PI LOBACH, DAVID F · 2000 to 2000
–
AHRQ HHS R01-HS10472AHRQ HHS R03-HS10814NIGMS NIH HHS T32-GM07171NLM NIH HHS F37-LM008161-01
6 · The paper itself

Abstract

objectiveTo identify features of clinical decision support systems critical for improving clinical practice.

designSystematic review of randomised controlled trials. DATA SOURCES: Literature searches via Medline, CINAHL, and the Cochrane Controlled Trials Register up to 2003; and searches of reference lists of included studies and relevant reviews. STUDY SELECTION: Studies had to evaluate the ability of decision support systems to improve clinical practice. DATA EXTRACTION: Studies were assessed for statistically and clinically significant improvement in clinical practice and for the presence of 15 decision support system features whose importance had been repeatedly suggested in the literature.

resultsSeventy studies were included. Decision support systems significantly improved clinical practice in 68% of trials. Univariate analyses revealed that, for five of the system features, interventions possessing the feature were significantly more likely to improve clinical practice than interventions lacking the feature. Multiple logistic regression analysis identified four features as independent predictors of improved clinical practice: automatic provision of decision support as part of clinician workflow (P < 0.00001), provision of recommendations rather than just assessments (P = 0.0187), provision of decision support at the time and location of decision making (P = 0.0263), and computer based decision support (P = 0.0294). Of 32 systems possessing all four features, 30 (94%) significantly improved clinical practice. Furthermore, direct experimental justification was found for providing periodic performance feedback, sharing recommendations with patients, and requesting documentation of reasons for not following recommendations.

conclusionsSeveral features were closely correlated with decision support systems' ability to improve patient care significantly. Clinicians and other stakeholders should implement clinical decision support systems that incorporate these features whenever feasible and appropriate.

Indexed as

Decision MakingDecision Support Systems, ClinicalProfessional PracticeRandomized Controlled Trials as TopicRegression Analysis

Identifiers

PMID15767266
PMCPMC555881

What OpenQuestion holds

Textmetadata
Read underepoch 390

Registered trials

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.