Evidence map›Paper›PMID 27161011›Full record

ArticleDatabase : the journal of biological databases and curation2016

BioCreative V CDR task corpus: a resource for chemical disease relation extraction.

Jiao Li, Yueping Sun, Robin J Johnson, Daniela Sciaky, Chih-Hsuan Wei, Robert Leaman, Allan Peter Davis, Carolyn J Mattingly, Thomas C Wiegers, Zhiyong Lu

Abstract read
In one paragraph

Article in Database : the journal of biological databases and curation, 2016. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 191 papers.

0numbers the graph read from it
0cells of the map it votes in
191citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

191 citing papers in PubMed.

  1. Article
  2. Article
  3. Review
  4. Article
  5. Article
  6. Article
  7. Article
  8. Review
  9. Article
  10. Article
  11. Article
  12. Article
  13. Article
  14. Article
  15. Article
  16. Article
  17. Article
  18. Article
  19. Scaling Biomedical Text-Mining: Transformers, GenAI, and Drug Discovery.Methods in molecular biology (Clifton, N.J.) · 2026
    Article
  20. Article

131 more citing papers are in PubMed but not listed here.

4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

10 authors.

Jiao Li1Institute of Medical Information, Chinese Academy of Medical Sciences, Beijing 100020, China.
Yueping Sun1Institute of Medical Information, Chinese Academy of Medical Sciences, Beijing 100020, China.
Robin J Johnson2Department of Biological Sciences and the Center for Human Health and the Environment, North Carolina State University, Raleigh, NC 27695, USA.
Daniela Sciaky2Department of Biological Sciences and the Center for Human Health and the Environment, North Carolina State University, Raleigh, NC 27695, USA.
Chih-Hsuan Wei3National Center for Biotechnology Information, Bethesda, MD 20894, USA.
Robert Leaman3National Center for Biotechnology Information, Bethesda, MD 20894, USA.
Allan Peter Davis2Department of Biological Sciences and the Center for Human Health and the Environment, North Carolina State University, Raleigh, NC 27695, USA.
Carolyn J Mattingly2Department of Biological Sciences and the Center for Human Health and the Environment, North Carolina State University, Raleigh, NC 27695, USA.
Thomas C Wiegers2Department of Biological Sciences and the Center for Human Health and the Environment, North Carolina State University, Raleigh, NC 27695, USA.
Zhiyong Lu3National Center for Biotechnology Information, Bethesda, MD 20894, USA zhiyong.lu@nih.gov.

Funding

Named Entity Recognition and Relationship Extraction in BiomedicineZIALM091813 · NLM · NATIONAL LIBRARY OF MEDICINE · PI LU, ZHIYONG · 2013 to 2022
$13.4M
The Comparative Toxicogenomics Database (CTD)R01ES014065 · NIEHS · NORTH CAROLINA STATE UNIVERSITY RALEIGH · PI DAVIS, ALLAN PETER, MATTINGLY, CAROLYN J. · 2006 to 2021
$10.5M
Generation of a centralized and integrated resource for exposure dataR01ES019604 · NIEHS · NORTH CAROLINA STATE UNIVERSITY RALEIGH · PI MATTINGLY, CAROLYN J. · 2011 to 2015
$1.3M
NIEHS NIH HHS ES014065NIEHS NIH HHS ES019604NIEHS NIH HHS R01 ES014065NIEHS NIH HHS R01 ES019604
6 · The paper itself

Abstract

Community-run, formal evaluations and manually annotated text corpora are critically important for advancing biomedical text-mining research. Recently in BioCreative V, a new challenge was organized for the tasks of disease named entity recognition (DNER) and chemical-induced disease (CID) relation extraction. Given the nature of both tasks, a test collection is required to contain both disease/chemical annotations and relation annotations in the same set of articles. Despite previous efforts in biomedical corpus construction, none was found to be sufficient for the task. Thus, we developed our own corpus called BC5CDR during the challenge by inviting a team of Medical Subject Headings (MeSH) indexers for disease/chemical entity annotation and Comparative Toxicogenomics Database (CTD) curators for CID relation annotation. To ensure high annotation quality and productivity, detailed annotation guidelines and automatic annotation tools were provided. The resulting BC5CDR corpus consists of 1500 PubMed articles with 4409 annotated chemicals, 5818 diseases and 3116 chemical-disease interactions. Each entity annotation includes both the mention text spans and normalized concept identifiers, using MeSH as the controlled vocabulary. To ensure accuracy, the entities were first captured independently by two annotators followed by a consensus annotation: The average inter-annotator agreement (IAA) scores were 87.49% and 96.05% for the disease and chemicals, respectively, in the test set according to the Jaccard similarity coefficient. Our corpus was successfully used for the BioCreative V challenge tasks and should serve as a valuable resource for the text-mining research community.Database URL: http://www.biocreative.org/tasks/biocreative-v/track-3-cdr/.

Indexed as

DiseaseComputational BiologyDatabases, FactualData MiningHumansToxicogenetics

Identifiers

PMID27161011
PMCPMC4860626

What OpenQuestion holds

Textmetadata
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.