Evidence map›Paper›PMID 39695394›Full record

Observational studyBMC medical research methodology2024

Comparing Medical Record Abstraction (MRA) error rates in an observational study to pooled rates identified in the data quality literature.

Maryam Y Garza, Tremaine B Williams, Songthip Ounpraseuth, Zhuopei Hu, Jeannette Lee, Jessica Snowden, Anita C Walden, Alan E Simon, Lori A Devlin, Leslie W Young and 1 more

Abstract readComparative StudyObservational Study
In one paragraph

Observational study in BMC medical research methodology, 2024. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 3 papers.

0numbers the graph read from it
0cells of the map it votes in
3citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

3 citing papers in PubMed.

  1. Article
  2. Article
  3. Article
4 · The record

Corrections and comments

5 · Who and what money

Authors and funding

11 authors.

Maryam Y GarzaDepartment of Biomedical Informatics, University of Arkansas for Medical Sciences, Little Rock, Arkansas, USA. garzam46@uthscsa.edu.
Tremaine B WilliamsDepartment of Biomedical Informatics, University of Arkansas for Medical Sciences, Little Rock, Arkansas, USA.
Songthip OunpraseuthDepartment of Biostatistics, University of Arkansas for Medical Sciences, Little Rock, Arkansas, USA.
Zhuopei HuDepartment of Biostatistics, University of Arkansas for Medical Sciences, Little Rock, Arkansas, USA.
Jeannette LeeDepartment of Biostatistics, University of Arkansas for Medical Sciences, Little Rock, Arkansas, USA.
Jessica SnowdenDepartment of Biostatistics, University of Arkansas for Medical Sciences, Little Rock, Arkansas, USA.
Anita C WaldenUniversity of Colorado Denver, Anschutz Medical Campus, Denver, CO, USA.
Alan E SimonNational Center for Health Statistics, Centers for Disease Control and Prevention, Hyattsville, MD, USA.
Lori A DevlinDepartment of Pediatrics, School of Medicine, University of Louisville, Louisville, KY, USA.
Leslie W YoungDepartment of Pediatrics, The Larner College of Medicine, University of Vermont, Burlington, VT, USA.
Meredith N ZozusUniversity of Texas Health Science Center at San Antonio, Joe R. & Teresa Lozano Long School of Medicine, San Antonio, TX, USA.

Funding

Data Coordinating and Operations Center for the ECHO IDeA States Pediatric Clinical Trials NetworkU24OD024957 · OD · UNIV OF ARKANSAS FOR MED SCIS · PI COURTNEY, SHERRY, OUNPRASEUTH, SONGTHIP T. · 2016 to 2024
$80.8M
Expanding Translational Research in ArkansasUL1TR003107 · NCATS · UNIV OF ARKANSAS FOR MED SCIS · PI JAMES, LAURA P · 2019 to 2023
$21.6M
NCATS NIH HHS UL1 TR003107NCATS NIH HHS UL1TR003107NICHD Eunice Kennedy Shriver National Institute of Child Health and Human Development KL2-TR003108NIH HHS U24 OD024957NIH HHS U24OD024957NIH National Institutes of Health National Center for Advancing Translational Sciences UG1-OD024954NIH National Institutes of Health National Center for Advancing Translational Sciences UG1-OD024955
6 · The paper itself

Abstract

backgroundMedical record abstraction (MRA) is a commonly used method for data collection in clinical research, but is prone to error, and the influence of quality control (QC) measures is seldom and inconsistently assessed during the course of a study. We employed a novel, standardized MRA-QC framework as part of an ongoing observational study in an effort to control MRA error rates. In order to assess the effectiveness of our framework, we compared our error rates against traditional MRA studies that had not reported using formalized MRA-QC methods. Thus, the objective of this study was to compare the MRA error rates derived from the literature with the error rates found in a study using MRA as the sole method of data collection that employed an MRA-QC framework.

methodsA comparison of the error rates derived from MRA-centric studies identified as part of a systematic literature review was conducted against those derived from an MRA-centric study that employed an MRA-QC framework to evaluate the effectiveness of the MRA-QC framework. An inverse variance-weighted meta-analytical method with Freeman-Tukey transformation was used to compute pooled effect size for both the MRA studies identified in the literature and the study that implemented the MRA-QC framework. The level of heterogeneity was assessed using the Q-statistic and Higgins and Thompson's I

resultsThe overall error rate from the MRA literature was 6.57%. Error rates for the study using our MRA-QC framework were between 1.04% (optimistic, all-field rate) and 2.57% (conservative, populated-field rate), 4.00-5.53% points less than the observed rate from the literature (p < 0.0001).

conclusionsReview of the literature indicated that the accuracy associated with MRA varied widely across studies. However, our results demonstrate that, with appropriate training and continuous QC, MRA error rates can be significantly controlled during the course of a clinical research study.

Indexed as

Data AccuracyObservational Studies as TopicQuality ControlData CollectionHumansMedical RecordsClinical data managementClinical researchData collectionData qualityMedical record abstraction

Identifiers

PMID39695394
PMCPMC11653794

What OpenQuestion holds

Textmetadata
LicenceCC BY-NC-ND
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.