Evidence map›Paper›PMID 32638010›Full record

ArticleJournal of the American Medical Informatics Association : JAMIA2020

Piloting a model-to-data approach to enable predictive analytics in health care through patient mortality prediction.

Timothy Bergquist, Yao Yan, Thomas Schaffter, Thomas Yu, Vikas Pejaver, Noah Hammarlund, Justin Prosser, Justin Guinney, Sean Mooney

Abstract read
In one paragraph

Article in Journal of the American Medical Informatics Association : JAMIA, 2020. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 8 papers.

0numbers the graph read from it
0cells of the map it votes in
8citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

8 citing papers in PubMed.

  1. Article
  2. Article
  3. Article
  4. Review
  5. Article
  6. Article
  7. Article
  8. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

9 authors.

Timothy BergquistBiomedical Informatics and Medical Education, University of Washington, Seattle, Washington, USA.
Yao YanMolecular Engineering and Sciences Institute, University of Washington, Seattle, Washington, USA.
Thomas SchaffterSage Bionetworks, Seattle, Washington, USA.
Thomas YuSage Bionetworks, Seattle, Washington, USA.
Vikas PejaverBiomedical Informatics and Medical Education, University of Washington, Seattle, Washington, USA.
Noah HammarlundBiomedical Informatics and Medical Education, University of Washington, Seattle, Washington, USA.
Justin ProsserInstitute for Translational Health Sciences, University of Washington, Seattle, Washington, USA.
Justin GuinneyBiomedical Informatics and Medical Education, University of Washington, Seattle, Washington, USA.
Sean MooneyBiomedical Informatics and Medical Education, University of Washington, Seattle, Washington, USA.

Funding

Transform Dissemination and Implementation Science in CTSA ProgramsUL1TR002319 · NCATS · UNIVERSITY OF WASHINGTON · PI John K. Amory · 2017 to 2026
$100.0M
CD2H - The National COVID Cohort Collaborative (N3C) IDeA CTR CollaborationU24TR002306 · NCATS · UNIVERSITY OF COLORADO DENVER · PI CHUTE, CHRISTOPHER G, EICHMANN, DAVID A. · 2017 to 2021
$28.9M
University of Washington Biomedical Informatics and Data Science Research Training ProgramT15LM007442 · NLM · UNIVERSITY OF WASHINGTON · PI JOHN H. GENNARI, Andrea L. Hartzler · 2002 to 2026
$19.6M
Advancing method benchmarking and data sharing through crowd-sourced competitions in cancer researchU24CA248265 · NCI · SAGE BIONETWORKS · PI BOUTROS, PAUL CHRISTOPHER, VARMA, SUSHEEL · 2020 to 2024
$4.1M
Integrative data science approaches for rare disease discovery in health recordsK99LM012992 · NLM · UNIVERSITY OF WASHINGTON · PI PEJAVER, VIKAS RAO · 2019 to 2020
$184k
NCATS NIH HHS U24 TR002306NCATS NIH HHS UL1 TR002319NCI NIH HHS U24 CA248265NLM NIH HHS K99 LM012992NLM NIH HHS T15 LM007442
6 · The paper itself

Abstract

objectiveThe development of predictive models for clinical application requires the availability of electronic health record (EHR) data, which is complicated by patient privacy concerns. We showcase the "Model to Data" (MTD) approach as a new mechanism to make private clinical data available for the development of predictive models. Under this framework, we eliminate researchers' direct interaction with patient data by delivering containerized models to the EHR data. MATERIALS AND

methodsWe operationalize the MTD framework using the Synapse collaboration platform and an on-premises secure computing environment at the University of Washington hosting EHR data. Containerized mortality prediction models developed by a model developer, were delivered to the University of Washington via Synapse, where the models were trained and evaluated. Model performance metrics were returned to the model developer.

resultsThe model developer was able to develop 3 mortality prediction models under the MTD framework using simple demographic features (area under the receiver-operating characteristic curve [AUROC], 0.693), demographics and 5 common chronic diseases (AUROC, 0.861), and the 1000 most common features from the EHR's condition/procedure/drug domains (AUROC, 0.921). DISCUSSION: We demonstrate the feasibility of the MTD framework to facilitate the development of predictive models on private EHR data, enabled by common data models and containerization software. We identify challenges that both the model developer and the health system information technology group encountered and propose future efforts to improve implementation.

conclusionsThe MTD framework lowers the barrier of access to EHR data and can accelerate the development and evaluation of clinical prediction models.

Indexed as

Computer SimulationElectronic Health RecordsMortalityPrognosisSoftwareConfidentialityData WarehousingFeasibility StudiesHumansInformation DisseminationPilot ProjectsROC Curveclinical informaticsdata sciencedata sharingelectronic health recordsprivacy

Identifiers

PMID32638010
PMCPMC7526463

What OpenQuestion holds

Textmetadata
LicenceCC BY-NC
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.