Evidence map›Paper›PMID 25038555›Full record

ArticleJournal of biomedical informatics2014

Limestone: high-throughput candidate phenotype generation via tensor factorization.

Joyce C Ho, Joydeep Ghosh, Steve R Steinhubl, Walter F Stewart, Joshua C Denny, Bradley A Malin, Jimeng Sun

Open access · greenAbstract read
In one paragraph

Article in Journal of biomedical informatics, 2014. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 59 papers.

0numbers the graph read from it
0cells of the map it votes in
59citing papers in PubMed
20.4field-weighted citation impact, top 1% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

59 citing papers in PubMed, 160 citations in OpenAlex.

  1. Article
  2. Review
  3. Unraveling Complex Temporal Patterns in EHRs via Robust Irregular Tensor Factorization.AMIA Joint Summits on Translational Science proceedings. AMIA Joint Summits on Translational Science · 2025
    Article
  4. Article
  5. Article
  6. Article
  7. Review
  8. Review
  9. Review
  10. Article
  11. Article
  12. Communication Efficient Federated Generalized Tensor Factorization for Collaborative Health Data Analytics.Proceedings of the ... International World-Wide Web Conference. International WWW Conference · 2021
    Article
  13. Recommendations for Reporting Machine Learning Analyses in Clinical Research.Circulation. Cardiovascular quality and outcomes · 2020
    Article
  14. LogPar: Logistic PARAFAC2 Factorization for Temporal Binary Data with Missing Values.KDD : proceedings. International Conference on Knowledge Discovery & Data Mining · 2020
    Article
  15. Article
  16. Article
  17. TASTE: Temporal and Static Tensor Factorization for Phenotyping Electronic Health Records.Proceedings of the ACM Conference on Health, Inference, and Learning · 2020
    Article
  18. Article
  19. Article
  20. Evaluating the Impact of Data Representation on EHR-Based Analytic Tasks.Studies in health technology and informatics · 2019
    Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

7 authors at 5 institutions in 1 country.

Joyce C HoDepartment of Electrical and Computer Engineering, The University of Texas at Austin, Austin, TX 78712, United States. Electronic address: joyceho@utexas.edu.
Joydeep GhoshDepartment of Electrical and Computer Engineering, The University of Texas at Austin, Austin, TX 78712, United States.
Steve R SteinhublScripps Translational Science Institute, Scripps Health, La Jolla, CA 92037, United States.
Walter F StewartSutter Health Research, Development, and Dissemination Team, Sutter Health, Walnut Creek, CA 94598, United States.
Joshua C DennyDepartment of Biomedical Informatics, Vanderbilt University, Nashville, TN 37232, United States; Department of Medicine, Vanderbilt University, Nashville, TN 37232, United States.
Bradley A MalinDepartment of Biomedical Informatics, Vanderbilt University, Nashville, TN 37232, United States; Department of Electrical Engineering and Computer Science, Vanderbilt University, Nashville, TN 37232, United States.
Jimeng SunSchool of Computational Science and Engineering at College of Computing, Georgia Institute of Technology, Atlanta, GA 30332, United States.
The University of Texas at Austin · USVanderbilt University · USGeorgia Institute of Technology · USScripps Research Institute · USSutter Health · US

Funding

Early Detection of Heart Failure via the Electronic Health Record in Primary CareR01HL116832 · NHLBI · CALIFORNIA PACIFIC MED CTR RES INSTITUTE · PI STEWART, WALTER F · 2013 to 2015
$1.5M
NHLBI NIH HHS R01 HL116832
6 · The paper itself

Abstract

The rapidly increasing availability of electronic health records (EHRs) from multiple heterogeneous sources has spearheaded the adoption of data-driven approaches for improved clinical research, decision making, prognosis, and patient management. Unfortunately, EHR data do not always directly and reliably map to medical concepts that clinical researchers need or use. Some recent studies have focused on EHR-derived phenotyping, which aims at mapping the EHR data to specific medical concepts; however, most of these approaches require labor intensive supervision from experienced clinical professionals. Furthermore, existing approaches are often disease-centric and specialized to the idiosyncrasies of the information technology and/or business practices of a single healthcare organization. In this paper, we propose Limestone, a nonnegative tensor factorization method to derive phenotype candidates with virtually no human supervision. Limestone represents the data source interactions naturally using tensors (a generalization of matrices). In particular, we investigate the interaction of diagnoses and medications among patients. The resulting tensor factors are reported as phenotype candidates that automatically reveal patient clusters on specific diagnoses and medications. Using the proposed method, multiple phenotypes can be identified simultaneously from data. We demonstrate the capability of Limestone on a cohort of 31,815 patient records from the Geisinger Health System. The dataset spans 7years of longitudinal patient records and was initially constructed for a heart failure onset prediction study. Our experiments demonstrate the robustness, stability, and the conciseness of Limestone-derived phenotypes. Our results show that using only 40 phenotypes, we can outperform the original 640 features (169 diagnosis categories and 471 medication types) to achieve an area under the receiver operator characteristic curve (AUC) of 0.720 (95% CI 0.715 to 0.725). Moreover, in consultation with a medical expert, we confirmed 82% of the top 50 candidates automatically extracted by Limestone are clinically meaningful.

Indexed as

AlgorithmsDatabases, FactualData MiningElectronic Health RecordsHumansPhenotypeDimensionality reductionEHR phenotypingNonnegative tensor factorization

Identifiers

PMID25038555
PMCPMC6563906
OpenAlexW2135496322

What OpenQuestion holds

Textmetadata
LicenceTDM
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.