SynthesisImplementation science : IS2023
Implementation costs of hospital-based computerised decision support systems: a systematic review.
Synthesis in Implementation science : IS, 2023. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 16 papers, 1 of them a synthesis that pooled it.
What it found
Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.
The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.
The trial behind it
Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.
Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.
Who cites it
16 citing papers in PubMed, 1 synthesis or guideline pooled it.
- How intervention studies measure the effectiveness of medication safety-related clinical decision support systems in primary and long-term care: a systematic review.BMC medical informatics and decision making · 2024Pooled it
- Multicenter Usability Evaluation and Co-Development of a Digital Decision-Support Tool for Labor Triage: Mixed Methods Study.JMIR human factors · 2026Article
- Factors Influencing Physician Adherence to Venous Thromboembolism Risk Assessment Model Recommendations: A Best-Worst Scaling.American journal of cardiovascular drugs : drugs, devices, and other interventions · 2026Article
- Optimizing AI implementation for surgery: recommendations for infrastructure and deployment in the operating room.NPJ digital medicine · 2026Article
- Best practices and challenges in executing large scale pilots for eHealth deployment and managing innovation: the GATEKEEPER experience.Frontiers in digital health · 2026Article
- Advancements in orthopaedic medical Education: Exploring novel teaching strategies - A qualitative systematic review.Journal of clinical orthopaedics and trauma · 2025Article
- Transforming Patient-Reported Outcome Measurement With Digital Health Technology.Journal of evaluation in clinical practice · 2025Article
- Development of an instrument (Cost-IS) to estimate costs of implementation strategies for digital health solutions: a modified e-Delphi study.Implementation science : IS · 2025Article
- Development and Evaluation of a GPT4-Based Orofacial Pain Clinical Decision Support System.Diagnostics (Basel, Switzerland) · 2024Article
- Challenges and recommendations for collecting and quantifying implementation costs in practice: a qualitative interview study.Implementation science communications · 2024Article
- Article
- Achieving Value by Risk Stratification With Machine Learning Model or Clinical Risk Score in Acute Upper Gastrointestinal Bleeding: A Cost Minimization Analysis.The American journal of gastroenterology · 2024Article
- We Ask and Listen: A Group-Wide Retrospective Survey on Satisfaction with Digital Medication Software.Journal of multidisciplinary healthcare · 2024Article
- Cost-effectiveness of left atrial appendage closure for stroke prevention in atrial fibrillation: a systematic review appraising the methodological quality.Cost effectiveness and resource allocation : C/E · 2023Article
- Identifying barriers and facilitators to successful implementation of computerized clinical decision support systems in hospitals: a NASSS framework-informed scoping review.Implementation science : IS · 2023Article
- Integrating Decision Science and Implementation Science to Inform Policy Decision Making.MDM policy & practiceReview
Corrections and comments
PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.
Authors and funding
5 authors.
Funding
No grant is acknowledged in the PubMed record.
Abstract
backgroundThe importance of accurately costing implementation strategies is increasingly recognised within the field of implementation science. However, there is a lack of methodological guidance for costing implementation, particularly within digital health settings. This study reports on a systematic review of costing analyses conducted alongside implementation of hospital-based computerised decision support systems.
methodsPubMed, Embase, Scopus and CINAHL databases were searched between January 2010 and August 2021. Two reviewers independently screened and selected original research studies that were conducted in a hospital setting, examined the implementation of a computerised decision support systems and reported implementation costs. The Expert Recommendations for Implementing Change Framework was used to identify and categorise implementation strategies into clusters. A previously published costing framework was applied to describe the methods used to measure and value implementation costs. The reporting quality of included studies was assessed using the Consolidated Health Economic Evaluation Reporting Standards checklist.
resultsTitles and abstracts of 1836 articles were screened, with nine articles eligible for inclusion in the review. Implementation costs were most frequently reported under the 'evaluative and iterative strategies' cluster, followed by 'provide interactive assistance'. Labour was the largest implementation-related cost in the included papers, irrespective of implementation strategy. Other reported costs included consumables, durable assets and physical space, which was mostly associated with stakeholder training. The methods used to cost implementation were often unclear. There was variation across studies in the overall quality of reporting.
conclusionsA relatively small number of papers have described computerised decision support systems implementation costs, and the methods used to measure and value these costs were not well reported. Priorities for future research should include establishing consistent terminology and appropriate methods for estimating and reporting on implementation costs.
trial registrationThe review protocol is registered with PROSPERO (ID: CRD42021272948).
Indexed as
Identifiers
What OpenQuestion holds
Registered trials
Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.