Evidence map›Paper›PMID 33319713›Full record

ArticleBMC medical informatics and decision making2020

Outlier concepts auditing methodology for a large family of biomedical ontologies.

Ling Zheng, Hua Min, Yan Chen, Vipina Keloth, James Geller, Yehoshua Perl, George Hripcsak

Abstract read
In one paragraph

Article in BMC medical informatics and decision making, 2020. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 3 papers.

0numbers the graph read from it
0cells of the map it votes in
3citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

3 citing papers in PubMed.

  1. Review
  2. Article
  3. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

7 authors.

Ling ZhengComputer Science and Software Engineering Department, Monmouth University, West Long Branch, NJ, 07764, USA. lzheng@monmouth.edu.ORCID 0000-0002-6709-828X
Hua MinDepartment of Health Administration and Policy, George Mason University, Fairfax, VA, 22030, USA.
Yan ChenCIS Department, Borough of Manhattan Community College, CUNY, New York, NY, 10007, USA.
Vipina KelothDepartment of Computer Science, New Jersey Institute of Technology, Newark, NJ, 07102, USA.
James GellerDepartment of Computer Science, New Jersey Institute of Technology, Newark, NJ, 07102, USA.
Yehoshua PerlDepartment of Computer Science, New Jersey Institute of Technology, Newark, NJ, 07102, USA.
George HripcsakDepartment of Biomedical Informatics, Columbia University, New York, NY, 10032, USA.

Funding

New Jersey Alliance for Clinical Translational Science: NJ ACTSUL1TR003017 · NCATS · RUTGERS BIOMEDICAL/HEALTH SCIENCES-RBHS · PI PANETTIERI, REYNOLD ALEXANDER · 2019 to 2023
$28.9M
DISCOVERING AND APPLYING KNOWLEDGE IN CLINICAL DATABASESR01LM006910 · NLM · COLUMBIA UNIVERSITY HEALTH SCIENCES · PI HRIPCSAK, GEORGE M · 2000 to 2023
$10.6M
A family-based framework of quality assurance for biomedical ontologiesR01CA190779 · NCI · NEW JERSEY INSTITUTE OF TECHNOLOGY · PI PERL, YEHOSHUA · 2015 to 2017
$1.8M
NCATS NIH HHS UL1 TR003017NCI NIH HHS R01 CA190779NLM NIH HHS R01 LM006910
6 · The paper itself

Abstract

backgroundSummarization networks are compact summaries of ontologies. The "Big Picture" view offered by summarization networks enables to identify sets of concepts that are more likely to have errors than control concepts. For ontologies that have outgoing lateral relationships, we have developed the "partial-area taxonomy" summarization network. Prior research has identified one kind of outlier concepts, concepts of small partials-areas within partial-area taxonomies. Previously we have shown that the small partial-area technique works successfully for four ontologies (or their hierarchies).

methodsTo improve the Quality Assurance (QA) scalability, a family-based QA framework, where one QA technique is potentially applicable to a whole family of ontologies with similar structural features, was developed. The 373 ontologies hosted at the NCBO BioPortal in 2015 were classified into a collection of families based on structural features. A meta-ontology represents this family collection, including one family of ontologies having outgoing lateral relationships. The process of updating the current meta-ontology is described. To conclude that one QA technique is applicable for at least half of the members for a family F, this technique should be demonstrated as successful for six out of six ontologies in F. We describe a hypothesis setting the condition required for a technique to be successful for a given ontology. The process of a study to demonstrate such success is described. This paper intends to prove the scalability of the small partial-area technique.

resultsWe first updated the meta-ontology classifying 566 BioPortal ontologies. There were 371 ontologies in the family with outgoing lateral relationships. We demonstrated the success of the small partial-area technique for two ontology hierarchies which belong to this family, SNOMED CT's Specimen hierarchy and NCIt's Gene hierarchy. Together with the four previous ontologies from the same family, we fulfilled the "six out of six" condition required to show the scalability for the whole family.

conclusionsWe have shown that the small partial-area technique can be potentially successful for the family of ontologies with outgoing lateral relationships in BioPortal, thus improve the scalability of this QA technique.

Indexed as

Biological OntologiesHumansSystematized Nomenclature of MedicineAuditing BioPortal ontologiesBiomedical ontologiesMeta-ontologyOntology auditing scalabilityOntology error concentrationOntology quality assuranceSummarization network

Identifiers

PMID33319713
PMCPMC7737254

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.