Evidence map›Paper›PMID 24471935›Full record

Observational studyHealth services research2014

Using computer-extracted data from electronic health records to measure the quality of adolescent well-care.

William Gardner, Suzanne Morton, Sepheen C Byron, Aldo Tinoco, Benjamin D Canan, Karen Leonhart, Vivian Kong, Sarah Hudson Scholle

Abstract readObservational Study
In one paragraph

Observational study in Health services research, 2014. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 8 papers.

0numbers the graph read from it
0cells of the map it votes in
8citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

8 citing papers in PubMed.

  1. Article
  2. Comparison of electronic versus manual abstraction for 2 standardized perinatal care measures.Journal of the American Medical Informatics Association : JAMIA · 2022
    Article
  3. Article
  4. Article
  5. Review
  6. Article
  7. Article
  8. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

8 authors.

William GardnerDepartment of Pediatrics, Dalhousie University, Halifax, NS.
Suzanne Morton
Sepheen C Byron
Aldo Tinoco
Benjamin D Canan
Karen Leonhart
Vivian Kong
Sarah Hudson Scholle

Funding

National Collaborative for Innovation in Quality Measurement (NCINQ)U18HS020503 · AHRQ · NATIONAL COMMITTEE FOR QUALITY ASSURANCE · PI SCHOLLE, SARAH H. · 2011 to 2014
$7.7M
AHRQ HHS U18 HS020503AHRQ HHS U18HS020503
6 · The paper itself

Abstract

objectiveTo determine whether quality measures based on computer-extracted EHR data can reproduce findings based on data manually extracted by reviewers. DATA SOURCES: We studied 12 measures of care indicated for adolescent well-care visits for 597 patients in three pediatric health systems. STUDY

designObservational study. DATA COLLECTION/EXTRACTION

methodsManual reviewers collected quality data from the EHR. Site personnel programmed their EHR systems to extract the same data from structured fields in the EHR according to national health IT standards. PRINCIPAL

findingsOverall performance measured via computer-extracted data was 21.9 percent, compared with 53.2 percent for manual data. Agreement measures were high for immunizations. Otherwise, agreement between computer extraction and manual review was modest (Kappa = 0.36) because computer-extracted data frequently missed care events (sensitivity = 39.5 percent). Measure validity varied by health care domain and setting. A limitation of our findings is that we studied only three domains and three sites.

conclusionsThe accuracy of computer-extracted EHR quality reporting depends on the use of structured data fields, with the highest agreement found for measures and in the setting that had the greatest concentration of structured fields. We need to improve documentation of care, data extraction, and adaptation of EHR systems to practice workflow.

Indexed as

Data MiningDirective CounselingElectronic Health RecordsQuality Indicators, Health CareAdolescentAdolescent Health ServicesChildComputersData CollectionFemaleHumansMaleYoung Adultelectronic health recordspediatric well-careQuality measurement

Identifiers

PMID24471935
PMCPMC4239847

What OpenQuestion holds

Textmetadata
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.