Evidence map›Paper›PMID 21249231›Full record

ArticlePLoS computational biology2011

Benchmarking ontologies: bigger or better?

Lixia Yao, Anna Divoli, Ilya Mayzus, James A Evans, Andrey Rzhetsky

Abstract read
In one paragraph

Article in PLoS computational biology, 2011. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 8 papers.

0numbers the graph read from it
0cells of the map it votes in
8citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

8 citing papers in PubMed.

  1. Review
  2. Article
  3. Article
  4. Evaluation of research in biomedical ontologies.Briefings in bioinformatics · 2013
    Article
  5. Article
  6. Article
  7. Article
  8. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

5 authors.

Lixia YaoDepartment of Biomedical Informatics, Columbia University, New York, New York, USA.
Anna Divoli
Ilya Mayzus
James A Evans
Andrey Rzhetsky

Funding

Nation Center: Multi-Scale Study- Cellular Networks(RMI)U54CA121852 · NCI · COLUMBIA UNIVERSITY HEALTH SCIENCES · PI CALIFANO, ANDREA · 2005 to 2015
$37.4M
Computer Systems for Functional Analysis of Genomic DataR01GM061372 · NIGMS · UNIVERSITY OF CHICAGO · PI RZHETSKY, ANDREY · 2001 to 2009
$2.8M
Large-scale Discovery of Scientific Hypotheses; Computation Over Expert OpinionsR01LM010132 · NLM · UNIVERSITY OF CHICAGO · PI EVANS, JAMES ALLEN, FOSTER, IAN · 2009 to 2010
$1.2M
NCI NIH HHS U54 CA121852NCI NIH HHS U54 CA121852-01A1NIGMS NIH HHS R01 GM061372NIGMS NIH HHS R01GM061372NLM NIH HHS R01 LM010132NLM NIH HHS R01LM010132
6 · The paper itself

Abstract

A scientific ontology is a formal representation of knowledge within a domain, typically including central concepts, their properties, and relations. With the rise of computers and high-throughput data collection, ontologies have become essential to data mining and sharing across communities in the biomedical sciences. Powerful approaches exist for testing the internal consistency of an ontology, but not for assessing the fidelity of its domain representation. We introduce a family of metrics that describe the breadth and depth with which an ontology represents its knowledge domain. We then test these metrics using (1) four of the most common medical ontologies with respect to a corpus of medical documents and (2) seven of the most popular English thesauri with respect to three corpora that sample language from medicine, news, and novels. Here we show that our approach captures the quality of ontological representation and guides efforts to narrow the breach between ontology and collective discourse within a domain. Our results also demonstrate key features of medical ontologies, English thesauri, and discourse from different domains. Medical ontologies have a small intersection, as do English thesauri. Moreover, dialects characteristic of distinct domains vary strikingly as many of the same words are used quite differently in medicine, news, and novels. As ontologies are intended to mirror the state of knowledge, our methods to tighten the fit between ontology and domain will increase their relevance for new areas of biomedical science and improve the accuracy and power of inferences computed across them.

Indexed as

Information Storage and Retrieval

Identifiers

PMID21249231
PMCPMC3020923

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.