Evidence map›Paper›PMID 36623759›Full record

ArticleClinical biochemistry2023

Targeting repetitive laboratory testing with electronic health records-embedded predictive decision support: A pre-implementation study.

Naveed Rabbani, Stephen P Ma, Ron C Li, Marcy Winget, Susan Weber, Srinivasan Boosi, Tho D Pham, David Svec, Lisa Shieh, Jonathan H Chen

Abstract read
In one paragraph

Article in Clinical biochemistry, 2023. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 11 papers.

0numbers the graph read from it
0cells of the map it votes in
11citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

11 citing papers in PubMed.

  1. Article
  2. Article
  3. [S1 guideline on sustainability in intensive care and emergency medicine].Medizinische Klinik, Intensivmedizin und Notfallmedizin · 2025
    Review
  4. Article
  5. Article
  6. Article
  7. Article
  8. Review
  9. Article
  10. Article
  11. Probabilistic Prediction of Laboratory Test Information Yield.AMIA ... Annual Symposium proceedings. AMIA Symposium · 2023
    Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

10 authors.

Naveed RabbaniDepartment of Pediatrics, Stanford University School of Medicine, Stanford, CA, USA; Stanford Center for Biomedical Informatics Research, Stanford University School of Medicine, Stanford, CA, USA. Electronic address: nrabbani@stanford.edu.
Stephen P MaDepartment of Medicine, Stanford University School of Medicine, Stanford, CA, USA.
Ron C LiDepartment of Medicine, Stanford University School of Medicine, Stanford, CA, USA.
Marcy WingetDivision of Primary Care and Population Health, Stanford University School of Medicine, Stanford, CA, USA.
Susan WeberTechnology and Digital Solutions, Stanford University School of Medicine, Stanford, CA, USA.
Srinivasan BoosiTechnology and Digital Solutions, Stanford University School of Medicine, Stanford, CA, USA.
Tho D PhamDepartment of Pathology, Stanford University School of Medicine, Stanford, CA, USA.
David SvecDepartment of Medicine, Stanford University School of Medicine, Stanford, CA, USA.
Lisa ShiehDepartment of Medicine, Stanford University School of Medicine, Stanford, CA, USA.
Jonathan H ChenStanford Center for Biomedical Informatics Research, Stanford University School of Medicine, Stanford, CA, USA; Department of Medicine, Stanford University School of Medicine, Stanford, CA, USA; Division of Hospital Medicine, Stanford University School of Medicine, Stanford, CA, USA; Clinical Excellence Research Center, Stanford University School of Medicine, Stanford, CA, USA.

Funding

Stanford Alzheimer's Disease Research CenterAdmin Supp: Developing iPSC models for AD and PDP30AG066515 · NIA · STANFORD UNIVERSITY · PI Jennifer Kaci Fairchild · 2020 to 2026
$29.0M
Stanford Medicine Center for Longevity and Healthy Aging Research Education CoreP30AG059307 · NIA · STANFORD UNIVERSITY · PI ZOU, JAMES · 2018 to 2025
$4.9M
Measuring and Predicting Appropriate Antibiotic Use to Combat Resistant BacteriaR01AI178121 · NIAID · STANFORD UNIVERSITY · PI JONATHAN H. CHEN · 2023 to 2026
$3.1M
Machine Learning Clinical Order Recommendations for Specialty Consultation CareR56LM013365 · NLM · STANFORD UNIVERSITY · PI CHEN, JONATHAN H. · 2020 to 2020
$394k
NIAID NIH HHS R01 AI178121NIA NIH HHS P30 AG059307NIA NIH HHS P30 AG066515NLM NIH HHS R56 LM013365
6 · The paper itself

Abstract

introductionUnnecessary laboratory testing contributes to patient morbidity and healthcare waste. Despite prior attempts at curbing such overutilization, there remains opportunity for improvement using novel data-driven approaches. This study presents the development and early evaluation of a clinical decision support tool that uses a predictive model to help providers reduce low-yield, repetitive laboratory testing in hospitalized patients.

methodsWe developed an EHR-embedded SMART on FHIR application that utilizes a laboratory test result prediction model based on historical laboratory data. A combination of semi-structured physician interviews, usability testing, and quantitative analysis on retrospective laboratory data were used to inform the tool's development and evaluate its acceptability and potential clinical impact. KEY

resultsPhysicians identified culture and lack of awareness of repeat orders as key drivers for overuse of inpatient blood testing. Users expressed an openness to a lab prediction model and 13/15 physicians believed the tool would alter their ordering practices. The application received a median System Usability Scale score of 75, corresponding to the 75th percentile of software tools. On average, physicians desired a prediction certainty of 85% before discontinuing a routine recurring laboratory order and a higher certainty of 90% before being alerted. Simulation on historical lab data indicates that filtering based on accepted thresholds could have reduced ∼22% of repeat chemistry panels.

conclusionsThe use of a predictive algorithm as a means to calculate the utility of a diagnostic test is a promising paradigm for curbing laboratory test overutilization. An EHR-embedded clinical decision support tool employing such a model is a novel and acceptable intervention with the potential to reduce low-yield, repetitive laboratory testing.

Indexed as

Decision Support Systems, ClinicalPhysiciansComputer SimulationElectronic Health RecordsHumansRetrospective StudiesSoftwareClinical decision supportHealthcare utilizationLaboratory information systemsLaboratory testingPrediction algorithms

Identifiers

PMID36623759
PMCPMC9936847

What OpenQuestion holds

Textmetadata
LicenceTDM
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.