Evidence map›Paper›PMID 29462669›Full record

ReviewJournal of biomedical informatics2018

Assessing the practice of biomedical ontology evaluation: Gaps and opportunities.

Muhammad Amith, Zhe He, Jiang Bian, Juan Antonio Lossio-Ventura, Cui Tao

Abstract readReview
In one paragraph

Review in Journal of biomedical informatics, 2018. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 40 papers.

0numbers the graph read from it
0cells of the map it votes in
40citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

40 citing papers in PubMed.

  1. Article
  2. Article
  3. Article
  4. Article
  5. A review on Gene Ontology evaluations.Database : the journal of biological databases and curation · 2025
    Review
  6. Article
  7. Article
  8. Article
  9. Article
  10. Article
  11. Article
  12. Article
  13. Article
  14. Article
  15. Article
  16. Article
  17. Article
  18. Review
  19. Article
  20. A substring replacement approach for identifying missing IS-A relations in SNOMED CT.Proceedings. IEEE International Conference on Bioinformatics and Biomedicine · 2022
    Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

5 authors.

Muhammad AmithSchool of Biomedical Informatics, University of Texas Health Science Center at Houston, Houston, TX, USA.
Zhe HeSchool of Information, Florida State University, Tallahassee, FL, USA.
Jiang BianDepartment of Health Outcomes and Biomedical Informatics, University of Florida, Gainesville, FL, USA.
Juan Antonio Lossio-VenturaDepartment of Health Outcomes and Biomedical Informatics, University of Florida, Gainesville, FL, USA.
Cui TaoSchool of Biomedical Informatics, University of Texas Health Science Center at Houston, Houston, TX, USA. Electronic address: Cui.Tao@uth.tmc.edu.

Funding

Using social networks to map and evaluate team science across CTSA hubsUL1TR001427 · NCATS · UNIVERSITY OF FLORIDA · PI MITCHELL, DUANE A. · 2015 to 2024
$37.2M
Dynamic learning for post-vaccine event prediction using temporal information in VAERSR01AI130460 · NIAID · UNIVERSITY OF TEXAS HLTH SCI CTR HOUSTON · PI CHEN, YONG, TAO, CUI · 2017 to 2021
$3.4M
Advancing Cancer Pharmacoepidemiology Research Through EHRs and InformaticsU24CA194215 · NCI · UNIVERSITY OF TEXAS HLTH SCI CTR HOUSTON · PI TAO, CUI, YANG, PING · 2016 to 2020
$3.3M
Patient Medical History Representation, Extraction, and Inference from EHR DataR01LM011829 · NLM · UNIVERSITY OF TEXAS HLTH SCI CTR HOUSTON · PI TAO, CUI · 2014 to 2018
$1.7M
Metadata applications on informed content to facilitate biorepository data regulation and sharingU01HG009454 · NHGRI · UNIVERSITY OF TEXAS HLTH SCI CTR HOUSTON · PI TAO, CUI · 2016 to 2018
$1.4M
NCATS NIH HHS UL1 TR001427NCI NIH HHS U24 CA194215NHGRI NIH HHS U01 HG009454NIAID NIH HHS R01 AI130460NLM NIH HHS R01 LM011829
6 · The paper itself

Abstract

With the proliferation of heterogeneous health care data in the last three decades, biomedical ontologies and controlled biomedical terminologies play a more and more important role in knowledge representation and management, data integration, natural language processing, as well as decision support for health information systems and biomedical research. Biomedical ontologies and controlled terminologies are intended to assure interoperability. Nevertheless, the quality of biomedical ontologies has hindered their applicability and subsequent adoption in real-world applications. Ontology evaluation is an integral part of ontology development and maintenance. In the biomedicine domain, ontology evaluation is often conducted by third parties as a quality assurance (or auditing) effort that focuses on identifying modeling errors and inconsistencies. In this work, we first organized four categorical schemes of ontology evaluation methods in the existing literature to create an integrated taxonomy. Further, to understand the ontology evaluation practice in the biomedicine domain, we reviewed a sample of 200 ontologies from the National Center for Biomedical Ontology (NCBO) BioPortal-the largest repository for biomedical ontologies-and observed that only 15 of these ontologies have documented evaluation in their corresponding inception papers. We then surveyed the recent quality assurance approaches for biomedical ontologies and their use. We also mapped these quality assurance approaches to the ontology evaluation criteria. It is our anticipation that ontology evaluation and quality assurance approaches will be more widely adopted in the development life cycle of biomedical ontologies.

Indexed as

Biological OntologiesElectronic Health RecordsHumansMedical InformaticsQuality Assurance, Health CareSemanticsBiomedical ontologiesKnowledge representationOntology evaluationQuality assurance

Identifiers

PMID29462669
PMCPMC5882531

What OpenQuestion holds

Textmetadata
LicenceTDM
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.