Evidence map›Paper›PMID 31255713›Full record

ArticleJournal of biomedical informatics2019

HPO2Vec+: Leveraging heterogeneous knowledge resources to enrich node embeddings for the Human Phenotype Ontology.

Feichen Shen, Suyuan Peng, Yadan Fan, Andrew Wen, Sijia Liu, Yanshan Wang, Liwei Wang, Hongfang Liu

Open access · greenAbstract read
In one paragraph

Article in Journal of biomedical informatics, 2019. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 16 papers.

0numbers the graph read from it
0cells of the map it votes in
16citing papers in PubMed
2.0field-weighted citation impact, top 13% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

16 citing papers in PubMed, 38 citations in OpenAlex.

  1. Article
  2. Article
  3. Article
  4. Article
  5. Article
  6. Article
  7. Machine learning approaches for electronic health records phenotyping: a methodical review.Journal of the American Medical Informatics Association : JAMIA · 2023
    Article
  8. Article
  9. Article
  10. Article
  11. Article
  12. Article
  13. Clinical concept extraction: A methodology review.Journal of biomedical informatics · 2020
    Review
  14. Article
  15. Article
  16. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

8 authors at 4 institutions in 2 countries.

Feichen ShenDepartment of Health Sciences Research, Mayo Clinic, Rochester, MN, USA. Electronic address: shen.feichen@mayo.edu.
Suyuan PengDepartment of Health Sciences Research, Mayo Clinic, Rochester, MN, USA; The Second Clinical College Guangzhou University of Chinese Medicine, China.
Yadan FanDepartment of Health Sciences Research, Mayo Clinic, Rochester, MN, USA; Institute for Health Informatics, University of Minnesota, Minneapolis, MN, USA.
Andrew WenDepartment of Health Sciences Research, Mayo Clinic, Rochester, MN, USA.
Sijia LiuDepartment of Health Sciences Research, Mayo Clinic, Rochester, MN, USA.
Yanshan WangDepartment of Health Sciences Research, Mayo Clinic, Rochester, MN, USA.
Liwei WangDepartment of Health Sciences Research, Mayo Clinic, Rochester, MN, USA.
Hongfang LiuDepartment of Health Sciences Research, Mayo Clinic, Rochester, MN, USA. Electronic address: liu.hongfang@mayo.edu.
Mayo Clinic in Florida · USMayo Clinic in Arizona · USGuangzhou University of Chinese Medicine · CNUniversity of Minnesota · US

Funding

Primary HyperoxaluriaU54DK083908 · NIDDK · MAYO CLINIC ROCHESTER · PI MILLINER, DAWN SCHMAUTZ · 2009 to 2018
$12.3M
South Carolina Clinical & Translational Research Institute (SCTR)UL1TR000062 · NCATS · MEDICAL UNIVERSITY OF SOUTH CAROLINA · PI BRADY, KATHLEEN T. · 2012 to 2014
$9.4M
Open Health Natural Language Processing CollaboratoryU01TR002062 · NCATS · MAYO CLINIC ROCHESTER · PI JIANG, XIAOQIAN, LIU, HONGFANG · 2017 to 2021
$7.6M
NCATS NIH HHS U01 TR002062NCATS NIH HHS UL1 TR000062NIDDK NIH HHS U54 DK083908
6 · The paper itself

Abstract

backgroundIn precision medicine, deep phenotyping is defined as the precise and comprehensive analysis of phenotypic abnormalities, aiming to acquire a better understanding of the natural history of a disease and its genotype-phenotype associations. Detecting phenotypic relevance is an important task when translating precision medicine into clinical practice, especially for patient stratification tasks based on deep phenotyping. In our previous work, we developed node embeddings for the Human Phenotype Ontology (HPO) to assist in phenotypic relevance measurement incorporating distributed semantic representations. However, the derived HPO embeddings hold only distributed representations for IS-A relationships among nodes, hampering the ability to fully explore the graph.

methodsIn this study, we developed a framework, HPO2Vec+, to enrich the produced HPO embeddings with heterogeneous knowledge resources (i.e., DECIPHER, OMIM, and Orphanet) for detecting phenotypic relevance. Specifically, we parsed disease-phenotype associations contained in these three resources to enrich non-inheritance relationships among phenotypic nodes in the HPO. To generate node embeddings for the HPO, node2vec was applied to perform node sampling on the enriched HPO graphs based on random walk followed by feature learning over the sampled nodes to generate enriched node embeddings. Four HPO embeddings were generated based on different graph structures, which we hereafter label as HPOEmb-Original, HPOEmb-DECIPHER, HPOEmb-OMIM, and HPOEmb-Orphanet. We evaluated the derived embeddings quantitatively through an HPO link prediction task with four edge embeddings operations and six machine learning algorithms. The resulting best embeddings were then evaluated for patient stratification of 10 rare diseases using electronic health records (EHR) collected at Mayo Clinic. We assessed our framework qualitatively by visualizing phenotypic clusters and conducting a use case study on primary hyperoxaluria (PH), a rare disease, on the task of inferring relevant phenotypes given 22 annotated PH related phenotypes.

resultsThe quantitative link prediction task shows that HPOEmb-Orphanet achieved an optimal AUROC of 0.92 and an average precision of 0.94. In addition, HPOEmb-Orphanet achieved an optimal F1 score of 0.86. The quantitative patient similarity measurement task indicates that HPOEmb-Orphanet achieved the highest average detection rate for similar patients over 10 rare diseases and performed better than other similarity measures implemented by an existing tool, HPOSim, especially for pairwise patients with fewer shared common phenotypes. The qualitative evaluation shows that the enriched HPO embeddings are generally able to detect relationships among nodes with fine granularity and HPOEmb-Orphanet is particularly good at associating phenotypes across different disease systems. For the use case of detecting relevant phenotypic characterizations for given PH related phenotypes, HPOEmb-Orphanet outperformed the other three HPO embeddings by achieving the highest average P@5 of 0.81 and the highest P@10 of 0.79. Compared to seven conventional similarity measurements provided by HPOSim, HPOEmb-Orphanet is able to detect more relevant phenotypic pairs, especially for pairs not in inheritance relationships.

conclusionWe drew the following conclusions based on the evaluation results. First, with additional non-inheritance edges, enriched HPO embeddings can detect more associations between fine granularity phenotypic nodes regardless of their topological structures in the HPO graph. Second, HPOEmb-Orphanet not only can achieve the optimal performance through link prediction and patient stratification based on phenotypic similarity, but is also able to detect relevant phenotypes closer to domain expert's judgments than other embeddings and conventional similarity measurements. Third, incorporating heterogeneous knowledge resources do not necessarily result in better performance for detecting relevant phenotypes. From a clinical perspective, in our use case study, clinical-oriented knowledge resources (e.g., Orphanet) can achieve better performance in detecting relevant phenotypic characterizations compared to biomedical-oriented knowledge resources (e.g., DECIPHER and OMIM).

Indexed as

Biological OntologiesPhenotypeAlgorithmsArea Under CurveComputer SimulationDatabases, GeneticElectronic Health RecordsGenetic Association StudiesHumansMachine LearningMedical InformaticsModels, StatisticalPrecision MedicineRare DiseasesROC CurveSemanticsDeep phenotypingEnriched node embeddingsHeterogeneous knowledge resourcesHuman Phenotype OntologyPhenotypic relevance detection

Identifiers

PMID31255713
PMCPMC6710011
OpenAlexW2954820957

What OpenQuestion holds

Textmetadata
LicenceTDM
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.