Evidence map›Paper›PMID 16230050›Full record

ArticleJournal of biomedical informatics2006

Inductive creation of an annotation schema for manually indexing clinical conditions from emergency department reports.

Wendy W Chapman, John N Dowling

Abstract read
In one paragraph

Article in Journal of biomedical informatics, 2006. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 10 papers.

0numbers the graph read from it
0cells of the map it votes in
10citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

10 citing papers in PubMed.

  1. Article
  2. Clinical text annotation - what factors are associated with the cost of time?AMIA ... Annual Symposium proceedings. AMIA Symposium · 2018
    Article
  3. Article
  4. Article
  5. Article
  6. A methodology for extending domain coverage in SemRep.Journal of biomedical informatics · 2013
    Article
  7. Semantic annotation of clinical events for generating a problem list.AMIA ... Annual Symposium proceedings. AMIA Symposium · 2013
    Article
  8. Building gold standard corpora for medical natural language processing tasks.AMIA ... Annual Symposium proceedings. AMIA Symposium · 2012
    Article
  9. A multi-site content analysis of social history information in clinical notes.AMIA ... Annual Symposium proceedings. AMIA Symposium · 2011
    Article
  10. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

2 authors.

Wendy W ChapmanCenter for Biomedical Informatics, University of Pittsburgh, Pittsburgh, PA, USA. chapman@cbmi.pitt.edu
John N Dowling

Funding

Natural Language Processing for Respiratory SurveillanceK22LM008301 · NLM · UNIVERSITY OF PITTSBURGH AT PITTSBURGH · PI CHAPMAN, WENDY W. · 2004 to 2006
$459k
NLM NIH HHS 1K22LM008301-01NLM NIH HHS K22 LM008301NLM NIH HHS K22 LM008301-02
6 · The paper itself

Abstract

Evaluating automated indexing applications requires comparing automatically indexed terms against manual reference standard annotations. However, there are no standard guidelines for determining which words from a textual document to include in manual annotations, and the vague task can result in substantial variation among manual indexers. We applied grounded theory to emergency department reports to create an annotation schema representing syntactic and semantic variables that could be annotated when indexing clinical conditions. We describe the annotation schema, which includes variables representing medical concepts (e.g., symptom, demographics), linguistic form (e.g., noun, adjective), and modifier types (e.g., anatomic location, severity). We measured the schema's quality and found: (1) the schema was comprehensive enough to be applied to 20 unseen reports without changes to the schema; (2) agreement between author annotators applying the schema was high, with an F measure of 93%; and (3) the authors made complementary errors when applying the schema, demonstrating that the schema incorporates both linguistic and medical expertise.

Indexed as

Artificial IntelligenceEmergency Service, HospitalMedical Records Systems, ComputerizedNatural Language ProcessingAbstracting and IndexingDocumentationInformation Storage and Retrieval

Identifiers

PMID16230050
PMCPMC1440922

What OpenQuestion holds

Textmetadata
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.