Evidence map›Paper›PMID 25925776›Full record

ArticleMethods of information in medicine2016

Quality Assurance of UMLS Semantic Type Assignments Using SNOMED CT Hierarchies.

H Gu, Y Chen, Z He, M Halper, L Chen

Open access · greenAbstract read
In one paragraph

Article in Methods of information in medicine, 2016. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 8 papers.

0numbers the graph read from it
0cells of the map it votes in
8citing papers in PubMed
0.9field-weighted citation impact, top 26% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

8 citing papers in PubMed, 14 citations in OpenAlex.

  1. An Automated Approach for Identifying Erroneous IS-A Relations in SNOMED CT.AMIA Joint Summits on Translational Science proceedings. AMIA Joint Summits on Translational Science · 2024
    Article
  2. A review of auditing techniques for the Unified Medical Language System.Journal of the American Medical Informatics Association : JAMIA · 2020
    Review
  3. Incidence, risk factors and re-exacerbation rate of severe asthma exacerbations in a multinational, multidatabase pediatric cohort study.Pediatric allergy and immunology : official publication of the European Society of Pediatric Allergy and Immunology · 2020
    Article
  4. Article
  5. Review
  6. Article
  7. A review of medical terminology standards and structured reporting.Journal of veterinary diagnostic investigation : official publication of the American Association of Veterinary Laboratory Diagnosticians, Inc · 2018
    Review
  8. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

5 authors at 3 institutions in 2 countries.

H GuDr. Huanying (Helen) Gu, Computer Science Department, New York Institute of Technology, 1855 Broadway New York, NY 10023-7692, USA, E-mail: hgu03@nyit.edu.
Y Chen
Z He
M Halper
L Chen
City University of New York · USColumbia University · USNew York Institute of Technology · CA

Funding

A family-based framework of quality assurance for biomedical ontologiesR01CA190779 · NCI · NEW JERSEY INSTITUTE OF TECHNOLOGY · PI PERL, YEHOSHUA · 2015 to 2017
$1.8M
Partitioning to Support Auditing and Extending the UMLSR01LM008445 · NLM · NEW JERSEY INSTITUTE OF TECHNOLOGY · PI PERL, YEHOSHUA · 2006 to 2009
$1.7M
NCI NIH HHS R01 CA190779NLM NIH HHS R01 LM008445
6 · The paper itself

Abstract

backgroundThe Unified Medical Language System (UMLS) is one of the largest biomedical terminological systems, with over 2.5 million concepts in its Metathesaurus repository. The UMLS's Semantic Network (SN) with its collection of 133 high-level semantic types serves as an abstraction layer on top of the Metathesaurus. In particular, the SN elaborates an aspect of the Metathesaurus's concepts via the assignment of one or more types to each concept. Due to the scope and complexity of the Metathesaurus, errors are all but inevitable in this semantic-type assignment process.

objectivesTo develop a semi-automated methodology to help assure the quality of semantic-type assignments within the UMLS.

methodsThe methodology uses a cross-validation strategy involving SNOMED CT's hierarchies in combination with UMLS semantic types. Semantically uniform, disjoint concept groups are generated programmatically by partitioning the collection of all concepts in the same SNOMED CT hierarchy according to their respective semantic-type assignments in the UMLS. Domain experts are then called upon to review the concepts in any group having a small number of concepts. It is our hypothesis that a semantic-type assignment combination applicable only to a very small number of concepts in a SNOMED CT hierarchy is an indicator of potential problems.

resultsThe methodology was applied to the UMLS 2013AA release along with the SNOMED CT from January 2013. An overall error rate of 33% was found for concepts proposed by the quality-assurance methodology. Supporting our hypothesis, that number was four times higher than the error rate found in control samples.

conclusionThe results show that the quality-assurance methodology can aid in effective and efficient identification of UMLS semantic-type assignment errors.

Indexed as

Quality Assurance, Health CareSemanticsSystematized Nomenclature of MedicineUnified Medical Language Systemauditing of terminologiesMedical terminologyquality assurancesemantic-type assignmentSNOMED CTUMLSUMLS auditing

Identifiers

PMID25925776
PMCPMC6537875
OpenAlexW2004600423

What OpenQuestion holds

Textmetadata
LicenceTDM
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.