Evidence map›Paper›PMID 26306281›Full record

ArticleAMIA Joint Summits on Translational Science proceedings. AMIA Joint Summits on Translational Science2015

Data-Mining Electronic Medical Records for Clinical Order Recommendations: Wisdom of the Crowd or Tyranny of the Mob?

Jonathan H Chen, Russ B Altman

Abstract read
In one paragraph

Article in AMIA Joint Summits on Translational Science proceedings. AMIA Joint Summits on Translational Science, 2015. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 10 papers.

0numbers the graph read from it
0cells of the map it votes in
10citing papers in PubMed
2.2field-weighted citation impact, top 9% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

10 citing papers in PubMed, 14 citations in OpenAlex.

  1. Trial
  2. Physician Usage and Acceptance of a Machine Learning Recommender System for Simulated Clinical Order Entry.AMIA Joint Summits on Translational Science proceedings. AMIA Joint Summits on Translational Science · 2020
    Article
  3. Article
  4. Neural Networks for Clinical Order Decision Support.AMIA Joint Summits on Translational Science proceedings. AMIA Joint Summits on Translational Science · 2019
    Article
  5. Integrating Clinical Knowledge and Real-World Evidence for Type 2 Diabetes Treatment.AMIA ... Annual Symposium proceedings. AMIA Symposium · 2019
    Article
  6. Article
  7. Article
  8. Article
  9. Article
  10. DYNAMICALLY EVOLVING CLINICAL PRACTICES AND IMPLICATIONS FOR PREDICTING MEDICAL DECISIONS.Pacific Symposium on Biocomputing. Pacific Symposium on Biocomputing · 2016
    Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

2 authors at 2 institutions in 1 country.

Jonathan H ChenCenter for Innovation to Implementation (Ci2i), Veterans Affairs Palo Alto Health Care System, Palo Alto, CA ; Center for Primary Care and Outcomes Research (PCOR), Stanford University, Stanford, CA.
Russ B AltmanDepartment of Medicine, Stanford University, Stanford, CA ; Departments of Bioengineering and Genetics, Stanford University, Stanford, CA.
Stanford University · USVA Palo Alto Health Care System · US

Funding

Spectrum Stanford Center for clinical and Translational Research and EducationUL1TR001085 · NCATS · STANFORD UNIVERSITY · PI CULLEN, MARK RICHARD, GREENBERG, HARRY BERNARD · 2013 to 2017
$37.1M
PharmGKB: pharmacogenomics knowledge for precision medicineR24GM061374 · NIGMS · STANFORD UNIVERSITY · PI ALTMAN, RUSS BIAGIO, KLEIN, TERI ELLEN · 2010 to 2018
$25.2M
Stanford Center for Clinical and Translational Education and Research (SCCTER)UL1UL1RR025744 · NCRR · STANFORD UNIVERSITY · PI GREENBERG, HARRY BERNARD · 2008 to 2011
$22.4M
Text Mining for High-fidelity Curation and Discovery of Gene-drug-phenotype RelationshipsR01LM005652 · NLM · STANFORD UNIVERSITY · PI ALTMAN, RUSS BIAGIO · 2000 to 2018
$6.2M
Undergraduate Summer Research Experiences Support for Combining systems biology and structural biology to find new therapeuticsR01GM102365 · NIGMS · STANFORD UNIVERSITY · PI ALTMAN, RUSS BIAGIO · 2012 to 2021
$3.0M
NCATS NIH HHS UL1 TR001085NCRR NIH HHS UL1 RR025744NIGMS NIH HHS R01 GM102365NIGMS NIH HHS R24 GM061374NLM NIH HHS R01 LM005652
6 · The paper itself

Abstract

Uncertainty and variability is pervasive in medical decision making with insufficient evidence-based medicine and inconsistent implementation where established knowledge exists. Clinical decision support constructs like order sets help distribute expertise, but are constrained by knowledge-based development. We previously produced a data-driven order recommender system to automatically generate clinical decision support content from structured electronic medical record data on >19K hospital patients. We now present the first structured validation of such automatically generated content against an objective external standard by assessing how well the generated recommendations correspond to orders referenced as appropriate in clinical practice guidelines. For example scenarios of chest pain, gastrointestinal hemorrhage, and pneumonia in hospital patients, the automated method identifies guideline reference orders with ROC AUCs (c-statistics) (0.89, 0.95, 0.83) that improve upon statistical prevalence benchmarks (0.76, 0.74, 0.73) and pre-existing human-expert authored order sets (0.81, 0.77, 0.73) (P<10(-30) in all cases). We demonstrate that data-driven, automatically generated clinical decision support content can reproduce and optimize top-down constructs like order sets while largely avoiding inappropriate and irrelevant recommendations. This will be even more important when extrapolating to more typical clinical scenarios where well-defined external standards and decision support do not exist.

Identifiers

PMID26306281
PMCPMC4525236
OpenAlexW2196201972

What OpenQuestion holds

Textmetadata
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.