Evidence map›Paper›PMID 22776079›Full record

ArticleBMC bioinformatics2012

Concept annotation in the CRAFT corpus.

Michael Bada, Miriam Eckert, Donald Evans, Kristin Garcia, Krista Shipley, Dmitry Sitnikov, William A Baumgartner, K Bretonnel Cohen, Karin Verspoor, Judith A Blake and 1 more

Abstract read
In one paragraph

Article in BMC bioinformatics, 2012. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 92 papers, 2 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
92citing papers in PubMed, 2 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

92 citing papers in PubMed, 2 syntheses or guidelines pooled it.

  1. Pooled it
  2. Pooled it
  3. Article
  4. Article
  5. Article
  6. Article
  7. Article
  8. Article
  9. Automated annotation of scientific texts for ML-based keyphrase extraction and validation.Database : the journal of biological databases and curation · 2024
    Article
  10. Article
  11. Article
  12. Ensemble pretrained language models to extract biomedical knowledge from literature.Journal of the American Medical Informatics Association : JAMIA · 2024
    Article
  13. Article
  14. Article
  15. Article
  16. Article
  17. Article
  18. Article
  19. Article
  20. Features of lexical complexity: insights from L1 and L2 speakers.Frontiers in artificial intelligence · 2023
    Article

32 more citing papers are in PubMed but not listed here.

4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

11 authors.

Michael BadaDepartment of Pharmacology, University of Colorado Anschutz Medical Campus, Aurora, CO, USA. mike.bada@ucdenver.edu
Miriam Eckert
Donald Evans
Kristin Garcia
Krista Shipley
Dmitry Sitnikov
William A Baumgartner
K Bretonnel Cohen
Karin Verspoor
Judith A Blake
Lawrence E Hunter

Funding

Mouse Genome DatabaseU41HG000330 · NHGRI · JACKSON LABORATORY · PI BLAKE, JUDITH A, BULT, CAROL J · 2011 to 2020
$45.5M
Computational Bioscience Program Training GrantT15LM009451 · NLM · UNIVERSITY OF COLORADO DENVER · PI Katherina Kechris-Mays, Arjun Krishnan · 2007 to 2026
$11.7M
Technology Development for a MolBio Knowledge-BaseR01LM008111 · NLM · UNIVERSITY OF COLORADO DENVER · PI HUNTER, LAWRENCE E · 2004 to 2021
$9.7M
Bio Text NLPR01LM009254 · NLM · UNIVERSITY OF COLORADO DENVER · PI HUNTER, LAWRENCE E · 2006 to 2018
$5.9M
NHGRI NIH HHS U41 HG000330NLM NIH HHS 2R01 LM009254NLM NIH HHS 3 T15 LM009451NLM NIH HHS 5R01 LM008111NLM NIH HHS 5 T15 LM009451
6 · The paper itself

Abstract

backgroundManually annotated corpora are critical for the training and evaluation of automated methods to identify concepts in biomedical text.

resultsThis paper presents the concept annotations of the Colorado Richly Annotated Full-Text (CRAFT) Corpus, a collection of 97 full-length, open-access biomedical journal articles that have been annotated both semantically and syntactically to serve as a research resource for the biomedical natural-language-processing (NLP) community. CRAFT identifies all mentions of nearly all concepts from nine prominent biomedical ontologies and terminologies: the Cell Type Ontology, the Chemical Entities of Biological Interest ontology, the NCBI Taxonomy, the Protein Ontology, the Sequence Ontology, the entries of the Entrez Gene database, and the three subontologies of the Gene Ontology. The first public release includes the annotations for 67 of the 97 articles, reserving two sets of 15 articles for future text-mining competitions (after which these too will be released). Concept annotations were created based on a single set of guidelines, which has enabled us to achieve consistently high interannotator agreement.

conclusionsAs the initial 67-article release contains more than 560,000 tokens (and the full set more than 790,000 tokens), our corpus is among the largest gold-standard annotated biomedical corpora. Unlike most others, the journal articles that comprise the corpus are drawn from diverse biomedical disciplines and are marked up in their entirety. Additionally, with a concept-annotation count of nearly 100,000 in the 67-article subset (and more than 140,000 in the full collection), the scale of conceptual markup is also among the largest of comparable corpora. The concept annotations of the CRAFT Corpus have the potential to significantly advance biomedical text mining by providing a high-quality gold standard for NLP systems. The corpus, annotation guidelines, and other associated resources are freely available at http://bionlp-corpora.sourceforge.net/CRAFT/index.shtml.

Indexed as

Data MiningNatural Language ProcessingVocabulary, ControlledComputational BiologyDatabases, FactualInformation Storage and RetrievalSemantics

Identifiers

PMID22776079
PMCPMC3476437

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.