Evidence map›Paper›PMID 37859860›Full record

ArticleFrontiers in medicine2023

Validation of automated data abstraction for SCCM discovery VIRUS COVID-19 registry: practical EHR export pathways (VIRUS-PEEP).

Diana J Valencia Morales, Vikas Bansal, Smith F Heavner, Janna C Castro, Mayank Sharma, Aysun Tekin, Marija Bogojevic, Simon Zec, Nikhil Sharma, Rodrigo Cartin-Ceba and 15 more

Abstract read
In one paragraph

Article in Frontiers in medicine, 2023. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 3 papers.

0numbers the graph read from it
0cells of the map it votes in
3citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

3 citing papers in PubMed.

  1. Article
  2. Article
  3. 21st century critical care medicine: An overview.World journal of critical care medicine · 2024
    Review
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

25 authors.

Diana J Valencia MoralesDivision of Critical Care Medicine, Department of Anesthesiology and Perioperative Care, Mayo Clinic, Rochester, MN, United States.
Vikas BansalDivision of Nephrology and Critical Care Medicine, Department of Internal Medicine, Mayo Clinic, Rochester, MN, United States.
Smith F HeavnerCURE Drug Repurposing Collaboratory, Critical Path Institute, Tucson, AZ, United States.
Janna C CastroDepartment of Information Technology, Mayo Clinic, Scottsdale, AZ, United States.
Mayank SharmaDivision of Critical Care Medicine, Department of Anesthesiology and Perioperative Care, Mayo Clinic, Rochester, MN, United States.
Aysun TekinDivision of Critical Care Medicine, Department of Anesthesiology and Perioperative Care, Mayo Clinic, Rochester, MN, United States.
Marija BogojevicDivision of Critical Care Medicine, Department of Anesthesiology and Perioperative Care, Mayo Clinic, Rochester, MN, United States.
Simon ZecDivision of Critical Care Medicine, Department of Anesthesiology and Perioperative Care, Mayo Clinic, Rochester, MN, United States.
Nikhil SharmaDivision of Nephrology and Critical Care Medicine, Department of Internal Medicine, Mayo Clinic, Rochester, MN, United States.
Rodrigo Cartin-CebaDivision of Critical Care Medicine, Department of Pulmonary Medicine, Mayo Clinic, Scottsdale, AZ, United States.
Rahul S NanchalDivision of Pulmonary and Critical Care Medicine, Department of Internal Medicine, Medical College of Wisconsin, Milwaukee, WI, United States.
Devang K SanghaviDepartment of Critical Care Medicine, Mayo Clinic Florida, Jacksonville, FL, United States.
Abigail T La NouDepartment of Critical Care Medicine, Mayo Clinic Health System, Eau Claire, WI, United States.
Syed A KhanDepartment of Critical Care Medicine, Mayo Clinic Health System, Mankato, MN, United States.
Katherine A BeldenDivision of Infectious Diseases, Sidney Kimmel Medical College at Thomas Jefferson University, Philadelphia, PA, United States.
Jen-Ting ChenDivision of Critical Care Medicine, Department of Internal Medicine, Montefiore Medical Center, Albert Einstein College of Medicine, Bronx, NY, United States.
Roman R MelamedDepartment of Critical Care Medicine, Abbott Northwestern Hospital, Allina Health, Minneapolis, MN, United States.
Imran A SayedDepartment of Pediatrics, Children's Hospital of Colorado, University of Colorado Anschutz Medical Campus, Colorado Springs, CO, United States.
Ronald A ReilkoffDivision of Pulmonary, Allergy, Critical Care and Sleep Medicine, Department of Internal Medicine, University of Minnesota Medical School, Edina, MN, United States.
Vitaly HerasevichDivision of Critical Care Medicine, Department of Anesthesiology and Perioperative Care, Mayo Clinic, Rochester, MN, United States.
Juan Pablo Domecq GarcesDivision of Nephrology and Critical Care Medicine, Department of Internal Medicine, Mayo Clinic, Rochester, MN, United States.
Allan J WalkeyDivision of Pulmonary, Allergy, Critical Care and Sleep Medicine, Department of Medicine, Evans Center of Implementation and Improvement Sciences, Boston University School of Medicine, Boston, MA, United States.
Karen BomanSociety of Critical Care Medicine, Mount Prospect, IL, United States.
Vishakha K KumarSociety of Critical Care Medicine, Mount Prospect, IL, United States.
Rahul KashyapDivision of Critical Care Medicine, Department of Anesthesiology and Perioperative Care, Mayo Clinic, Rochester, MN, United States.

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

Background: The gold standard for gathering data from electronic health records (EHR) has been manual data extraction; however, this requires vast resources and personnel. Automation of this process reduces resource burdens and expands research opportunities. Objective: This study aimed to determine the feasibility and reliability of automated data extraction in a large registry of adult COVID-19 patients. Materials and methods: This observational study included data from sites participating in the SCCM Discovery VIRUS COVID-19 registry. Important demographic, comorbidity, and outcome variables were chosen for manual and automated extraction for the feasibility dataset. We quantified the degree of agreement with Cohen's kappa statistics for categorical variables. The sensitivity and specificity were also assessed. Correlations for continuous variables were assessed with Pearson's correlation coefficient and Bland-Altman plots. The strength of agreement was defined as almost perfect (0.81-1.00), substantial (0.61-0.80), and moderate (0.41-0.60) based on kappa statistics. Pearson correlations were classified as trivial (0.00-0.30), low (0.30-0.50), moderate (0.50-0.70), high (0.70-0.90), and extremely high (0.90-1.00). Measurements and main results: The cohort included 652 patients from 11 sites. The agreement between manual and automated extraction for categorical variables was almost perfect in 13 (72.2%) variables (Race, Ethnicity, Sex, Coronary Artery Disease, Hypertension, Congestive Heart Failure, Asthma, Diabetes Mellitus, ICU admission rate, IMV rate, HFNC rate, ICU and Hospital Discharge Status), and substantial in five (27.8%) (COPD, CKD, Dyslipidemia/Hyperlipidemia, NIMV, and ECMO rate). The correlations were extremely high in three (42.9%) variables (age, weight, and hospital LOS) and high in four (57.1%) of the continuous variables (Height, Days to ICU admission, ICU LOS, and IMV days). The average sensitivity and specificity for the categorical data were 90.7 and 96.9%. Conclusion and relevance: Our study confirms the feasibility and validity of an automated process to gather data from the EHR.

Indexed as

COVID-19data automationelectronic health recordsvalidationVIRUS COVID-19 registry

Identifiers

PMID37859860
PMCPMC10583598

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.