Evidence map›Paper›PMID 36539234›Full record

ArticleJournal of the American Medical Informatics Association : JAMIA2023

A deep learning approach to identify missing is-a relations in SNOMED CT.

Rashmie Abeysinghe, Fengbo Zheng, Elmer V Bernstam, Jay Shi, Olivier Bodenreider, Licong Cui

Abstract read
In one paragraph

Article in Journal of the American Medical Informatics Association : JAMIA, 2023. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 7 papers.

0numbers the graph read from it
0cells of the map it votes in
7citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

7 citing papers in PubMed.

  1. Article
  2. Observational
  3. Quantitatively assessing the impact of the quality of SNOMED CT subtype hierarchy on cohort queries.Journal of the American Medical Informatics Association : JAMIA · 2025
    Article
  4. Article
  5. Article
  6. An Automated Approach for Identifying Erroneous IS-A Relations in SNOMED CT.AMIA Joint Summits on Translational Science proceedings. AMIA Joint Summits on Translational Science · 2024
    Article
  7. A GCN-based approach to uncover misaligned synonymous terms in the UMLS Metathesaurus.AMIA ... Annual Symposium proceedings. AMIA Symposium · 2023
    Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

6 authors.

Rashmie AbeysingheDepartment of Neurology, McGovern Medical School, The University of Texas Health Science Center at Houston, Houston, Texas, USA.
Fengbo ZhengSchool of Biomedical Informatics, The University of Texas Health Science Center at Houston, Houston, Texas, USA.
Elmer V BernstamSchool of Biomedical Informatics, The University of Texas Health Science Center at Houston, Houston, Texas, USA.
Jay ShiIntermountain Healthcare, Denver, Colorado, USA.
Olivier BodenreiderNational Library of Medicine, National Institutes of Health, Bethesda, Maryland, USA.
Licong CuiSchool of Biomedical Informatics, The University of Texas Health Science Center at Houston, Houston, Texas, USA.ORCID 0000-0001-5549-8780

Funding

Center for Clinical and Translational Sciences (CCTS)UL1TR000371 · NCATS · UNIVERSITY OF TEXAS HLTH SCI CTR HOUSTON · PI MCPHERSON, DAVID D · 2012 to 2016
$13.4M
Medical Ontology ResearchZIALM010017 · NLM · NATIONAL LIBRARY OF MEDICINE · PI BODENREIDER, OLIVIER · 2021 to 2023
$6.0M
Harnessing the power of CTSA-CDRN data networks: Using social determinants of health, frailty and functional status to identify at-risk patients and improve risk adjustmentU01TR002393 · NCATS · UNIVERSITY OF TEXAS HLTH SCIENCE CENTER · PI SHIREMAN, PAULA K · 2018 to 2021
$3.1M
An informatics framework for SUDEP Risk Marker Identification and Risk AssessmentR01NS116287 · NINDS · UNIVERSITY OF TEXAS HLTH SCI CTR HOUSTON · PI CUI, LICONG · 2020 to 2024
$1.7M
Biomedical Terminology Quality Assurance for Enhancing Clinical Queries over Electronic Health RecordsR01LM013335 · NLM · UNIVERSITY OF TEXAS HLTH SCI CTR HOUSTON · PI CUI, LICONG · 2020 to 2021
$663k
NCATS NIH HHS U01 TR002393NCATS NIH HHS UL1 TR000371NCATS NIH HHS UL1TR000371NINDS NIH HHS R01 NS116287NINDS NIH HHS R01NS116287NLM NIH HHS R01 LM013335NLM NIH HHS R01LM013335
6 · The paper itself

Abstract

objectiveSNOMED CT is the largest clinical terminology worldwide. Quality assurance of SNOMED CT is of utmost importance to ensure that it provides accurate domain knowledge to various SNOMED CT-based applications. In this work, we introduce a deep learning-based approach to uncover missing is-a relations in SNOMED CT. MATERIALS AND

methodsOur focus is to identify missing is-a relations between concept-pairs exhibiting a containment pattern (ie, the set of words of one concept being a proper subset of that of the other concept). We use hierarchically related containment concept-pairs as positive instances and hierarchically unrelated containment concept-pairs as negative instances to train a model predicting whether an is-a relation exists between 2 concepts with containment pattern. The model is a binary classifier leveraging concept name features, hierarchical features, enriched lexical attribute features, and logical definition features. We introduce a cross-validation inspired approach to identify missing is-a relations among all hierarchically unrelated containment concept-pairs.

resultsWe trained and applied our model on the Clinical finding subhierarchy of SNOMED CT (September 2019 US edition). Our model (based on the validation sets) achieved a precision of 0.8164, recall of 0.8397, and F1 score of 0.8279. Applying the model to predict actual missing is-a relations, we obtained a total of 1661 potential candidates. Domain experts performed evaluation on randomly selected 230 samples and verified that 192 (83.48%) are valid.

conclusionsThe results showed that our deep learning approach is effective in uncovering missing is-a relations between containment concept-pairs in SNOMED CT.

Indexed as

Deep LearningSystematized Nomenclature of Medicinedeep learningmissing is-a relationsontology quality assuranceSNOMED CT

Identifiers

PMID36539234
PMCPMC9933066

What OpenQuestion holds

Textmetadata
LicenceCC BY-NC
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.