Evidence map›Paper›PMID 25848598›Full record

ArticleEGEMS (Washington, DC)2014

Automating data abstraction in a quality improvement platform for surgical and interventional procedures.

Meliha Yetisgen, Prescott Klassen, Peter Tarczy-Hornoch

Abstract read
In one paragraph

Article in EGEMS (Washington, DC), 2014. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 7 papers.

0numbers the graph read from it
0cells of the map it votes in
7citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

7 citing papers in PubMed.

  1. Article
  2. Article
  3. Article
  4. Article
  5. Review
  6. Article
  7. Can Patient Record Summarization Support Quality Metric Abstraction?AMIA ... Annual Symposium proceedings. AMIA Symposium · 2016
    Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

3 authors.

Meliha YetisgenUniversity of Washington.
Prescott KlassenUniversity of Washington.
Peter Tarczy-HornochUniversity of Washington.

Funding

Surgical Care and Outcomes Assessment Program Comparative Effectiveness ResearchR01HS020025 · AHRQ · UNIVERSITY OF WASHINGTON · PI FLUM, DAVID R · 2010 to 2010
$10.8M
AHRQ HHS R01 HS020025
6 · The paper itself

Abstract

objectiveThis paper describes a text processing system designed to automate the manual data abstraction process in a quality improvement (QI) program. The Surgical Care and Outcomes Assessment Program (SCOAP) is a clinician-led, statewide performance benchmarking QI platform for surgical and interventional procedures. The data elements abstracted as part of this program cover a wide range of clinical information from patient medical history to details of surgical interventions.

methodsStatistical and rule-based extractors were developed to automatically abstract data elements. A preprocessing pipeline was created to chunk free-text notes into its sections, sentences, and tokens. The information extracted in this preprocessing step was used by the statistical and rule-based extractors as features.

findingsPerformance results for 25 extractors (14 statistical, 11 rule based) are presented. The average f1-scores for 11 rule-based extractors and 14 statistical extractors are 0.785 (min=0.576,max=0.931,std-dev=0.113) and 0.812 (min=0.571,max=0.993,std-dev=0.135) respectively. DISCUSSION: Our error analysis revealed that most extraction errors were due either to data imbalance in the data set or the way the gold standard had been created.

conclusionAs future work, more experiments will be conducted with a more comprehensive data set from multiple institutions contributing to the QI project.

Identifiers

PMID25848598
PMCPMC4371448

What OpenQuestion holds

Textmetadata
LicenceCC BY-NC-ND
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.