Evidence map›Paper›PMID 25048351›Full record

ArticleJournal of biomedical informatics2014

Relational machine learning for electronic health record-driven phenotyping.

Peggy L Peissig, Vitor Santos Costa, Michael D Caldwell, Carla Rottscheit, Richard L Berg, Eneida A Mendonca, David Page

Abstract read
In one paragraph

Article in Journal of biomedical informatics, 2014. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 33 papers.

0numbers the graph read from it
0cells of the map it votes in
33citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

33 citing papers in PubMed.

  1. Article
  2. Article
  3. Article
  4. Article
  5. Article
  6. Article
  7. Comparative analysis of weka-based classification algorithms on medical diagnosis datasets.Technology and health care : official journal of the European Society for Engineering and Medicine · 2023
    Article
  8. Article
  9. Article
  10. Review
  11. Vaginal Birth After Cesarean Section (VBAC) Model using Fuzzy Analytic Hierarch Process.Acta informatica medica : AIM : journal of the Society for Medical Informatics of Bosnia & Herzegovina : casopis Drustva za medicinsku informatiku BiH · 2021
    Article
  12. Article
  13. Article
  14. Article
  15. Article
  16. Article
  17. Article
  18. Review
  19. Article
  20. Review
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

7 authors.

Peggy L PeissigBiomedical Informatics Research Center, Marshfield Clinic Research Foundation, Marshfield, WI, USA. Electronic address: peissig.peggy@marshfieldclinic.org.
Vitor Santos CostaDCC-FCUP and CRACS INESC-TEC, Department de Ciência de Computadores, Universidade do Porto, Portugal.
Michael D CaldwellDepartment of Surgery, Marshfield Clinic, Marshfield, WI, USA.
Carla RottscheitBiomedical Informatics Research Center, Marshfield Clinic Research Foundation, Marshfield, WI, USA.
Richard L BergBiomedical Informatics Research Center, Marshfield Clinic Research Foundation, Marshfield, WI, USA.
Eneida A MendoncaDepartment of Biostatistics and Medical Informatics, University of Wisconsin-Madison, USA; Department of Pediatrics, University of Wisconsin-Madison, USA.
David PageDepartment of Biostatistics and Medical Informatics, University of Wisconsin-Madison, USA; Department of Computer Sciences, University of Wisconsin-Madison, USA.

Funding

Institutional Clinical and Translational Science AwardUL1TR000427 · NCATS · UNIVERSITY OF WISCONSIN-MADISON · PI DREZNER, MARC KENNETH · 2012 to 2016
$32.2M
INSTITUTIONAL CTSA (UW-MADISON): CLINICAL TRIALSUL1RR025011 · NCRR · UNIVERSITY OF WISCONSIN-MADISON · PI DREZNER, MARC KENNETH · 2007 to 2011
$29.5M
Machine Learning for Identifying Adverse Drug EventsR01GM097618 · NIGMS · UNIVERSITY OF WISCONSIN-MADISON · PI CALDWELL, MICHAEL DEFOIX, HANSEN, RICHARD A. · 2011 to 2018
$3.8M
Genome-Wide Study of Cataract and Low HDL in the Personalized Medicine Research PU01HG004608 · NHGRI · MARSHFIELD CLINIC RESEARCH FOUNDATION · PI MCCARTY, CATHERINE ANNE · 2007 to 2010
$3.3M
Secure Sharing of Clinical History & Genetic Data: Empowering Predictive Pers. MeR01LM011028 · NLM · UNIVERSITY OF WISCONSIN-MADISON · PI PAGE, CHARLES DAVID · 2011 to 2014
$2.2M
NCATS NIH HHS UL1 TR000427NCATS NIH HHS UL1TR000427NCRR NIH HHS 1UL1RR025011NCRR NIH HHS UL1 RR025011NHGRI NIH HHS U01 HG004608NHGRI NIH HHS U01-HG-004608NIGMS NIH HHS R01 GM097618NIGMS NIH HHS R01GM097618-01NLM NIH HHS R01 LM011028
6 · The paper itself

Abstract

objectiveElectronic health records (EHR) offer medical and pharmacogenomics research unprecedented opportunities to identify and classify patients at risk. EHRs are collections of highly inter-dependent records that include biological, anatomical, physiological, and behavioral observations. They comprise a patient's clinical phenome, where each patient has thousands of date-stamped records distributed across many relational tables. Development of EHR computer-based phenotyping algorithms require time and medical insight from clinical experts, who most often can only review a small patient subset representative of the total EHR records, to identify phenotype features. In this research we evaluate whether relational machine learning (ML) using inductive logic programming (ILP) can contribute to addressing these issues as a viable approach for EHR-based phenotyping.

methodsTwo relational learning ILP approaches and three well-known WEKA (Waikato Environment for Knowledge Analysis) implementations of non-relational approaches (PART, J48, and JRIP) were used to develop models for nine phenotypes. International Classification of Diseases, Ninth Revision (ICD-9) coded EHR data were used to select training cohorts for the development of each phenotypic model. Accuracy, precision, recall, F-Measure, and Area Under the Receiver Operating Characteristic (AUROC) curve statistics were measured for each phenotypic model based on independent manually verified test cohorts. A two-sided binomial distribution test (sign test) compared the five ML approaches across phenotypes for statistical significance.

resultsWe developed an approach to automatically label training examples using ICD-9 diagnosis codes for the ML approaches being evaluated. Nine phenotypic models for each ML approach were evaluated, resulting in better overall model performance in AUROC using ILP when compared to PART (p=0.039), J48 (p=0.003) and JRIP (p=0.003). DISCUSSION: ILP has the potential to improve phenotyping by independently delivering clinically expert interpretable rules for phenotype definitions, or intuitive phenotypes to assist experts.

conclusionRelational learning using ILP offers a viable approach to EHR-driven phenotyping.

Indexed as

Artificial IntelligenceAlgorithmsDatabases, FactualData MiningElectronic Health RecordsHumansElectronic health recordInductive logic programmingMachine learningPhenotypingRelational machine learning

Identifiers

PMID25048351
PMCPMC4261015

What OpenQuestion holds

Textmetadata
LicenceTDM
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.