Evidence map›Paper›PMID 27655861›Full record

ArticleJournal of the American Medical Informatics Association : JAMIA2017

Predicting inpatient clinical order patterns with probabilistic topic models vs conventional order sets.

Jonathan H Chen, Mary K Goldstein, Steven M Asch, Lester Mackey, Russ B Altman

Abstract readComparative Study
In one paragraph

Article in Journal of the American Medical Informatics Association : JAMIA, 2017. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 34 papers.

0numbers the graph read from it
0cells of the map it votes in
34citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

34 citing papers in PubMed.

  1. Trial
  2. Article
  3. Review
  4. Article
  5. Review
  6. Article
  7. Article
  8. Combining text mining with clinical decision support in clinical practice: a scoping review.Journal of the American Medical Informatics Association : JAMIA · 2023
    Article
  9. Article
  10. Article
  11. Article
  12. Article
  13. Article
  14. Article
  15. The Canadian journal of hospital pharmacy · 2021
    Article
  16. Article
  17. Article
  18. Article
  19. Article
  20. Physician Usage and Acceptance of a Machine Learning Recommender System for Simulated Clinical Order Entry.AMIA Joint Summits on Translational Science proceedings. AMIA Joint Summits on Translational Science · 2020
    Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

5 authors.

Jonathan H ChenDepartment of Medicine, Stanford University, Stanford, CA, USA.
Mary K GoldsteinGeriatrics Research Education and Clinical Center, Veteran Affairs Palo Alto Health Care System, Palo Alto, CA, USA.
Steven M AschDepartment of Medicine, Stanford University, Stanford, CA, USA.
Lester MackeyDepartment of Statistics, Stanford University, Stanford, CA, USA.
Russ B AltmanDepartment of Medicine, Stanford University, Stanford, CA, USA.

Funding

Spectrum Stanford Center for clinical and Translational Research and EducationUL1TR001085 · NCATS · STANFORD UNIVERSITY · PI CULLEN, MARK RICHARD, GREENBERG, HARRY BERNARD · 2013 to 2017
$37.1M
PharmGKB: pharmacogenomics knowledge for precision medicineR24GM061374 · NIGMS · STANFORD UNIVERSITY · PI ALTMAN, RUSS BIAGIO, KLEIN, TERI ELLEN · 2010 to 2018
$25.2M
Stanford Center for Clinical and Translational Education and Research (SCCTER)UL1UL1RR025744 · NCRR · STANFORD UNIVERSITY · PI GREENBERG, HARRY BERNARD · 2008 to 2011
$22.4M
Text Mining for High-fidelity Curation and Discovery of Gene-drug-phenotype RelationshipsR01LM005652 · NLM · STANFORD UNIVERSITY · PI ALTMAN, RUSS BIAGIO · 2000 to 2018
$6.2M
Undergraduate Summer Research Experiences Support for Combining systems biology and structural biology to find new therapeuticsR01GM102365 · NIGMS · STANFORD UNIVERSITY · PI ALTMAN, RUSS BIAGIO · 2012 to 2021
$3.0M
Data-Mining Clinical Decision Support from Electronic Health RecordsK01ES026837 · NIEHS · STANFORD UNIVERSITY · PI CHEN, JONATHAN H. · 2015 to 2019
$893k
NCATS NIH HHS UL1 TR001085NCRR NIH HHS UL1 RR025744NIEHS NIH HHS K01 ES026837NIGMS NIH HHS R01 GM102365NIGMS NIH HHS R24 GM061374NLM NIH HHS R01 LM005652
6 · The paper itself

Abstract

objectiveBuild probabilistic topic model representations of hospital admissions processes and compare the ability of such models to predict clinical order patterns as compared to preconstructed order sets. MATERIALS AND

methodsThe authors evaluated the first 24 hours of structured electronic health record data for > 10 K inpatients. Drawing an analogy between structured items (e.g., clinical orders) to words in a text document, the authors performed latent Dirichlet allocation probabilistic topic modeling. These topic models use initial clinical information to predict clinical orders for a separate validation set of > 4 K patients. The authors evaluated these topic model-based predictions vs existing human-authored order sets by area under the receiver operating characteristic curve, precision, and recall for subsequent clinical orders.

resultsExisting order sets predict clinical orders used within 24 hours with area under the receiver operating characteristic curve 0.81, precision 16%, and recall 35%. This can be improved to 0.90, 24%, and 47% ( P  < 10 -20 ) by using probabilistic topic models to summarize clinical data into up to 32 topics. Many of these latent topics yield natural clinical interpretations (e.g., "critical care," "pneumonia," "neurologic evaluation"). DISCUSSION: Existing order sets tend to provide nonspecific, process-oriented aid, with usability limitations impairing more precise, patient-focused support. Algorithmic summarization has the potential to breach this usability barrier by automatically inferring patient context, but with potential tradeoffs in interpretability.

conclusionProbabilistic topic modeling provides an automated approach to detect thematic trends in patient care and generate decision support content. A potential use case finds related clinical orders for decision support.

Indexed as

AlgorithmsDecision Support Systems, ClinicalElectronic Health RecordsMedical Order Entry SystemsModels, StatisticalPatient CareData MiningDiagnostic Tests, RoutineHospitalizationHumansROC Curveclinical decision support systemsclinical summarizationdata miningelectronic health recordsorder setsprobabilistic topic modeling

Identifiers

PMID27655861
PMCPMC5391730

What OpenQuestion holds

Textmetadata
LicenceCC BY-NC
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.