Evidence map›Paper›PMID 35917481›Full record

ArticleJMIR medical informatics2022

Issues With Variability in Electronic Health Record Data About Race and Ethnicity: Descriptive Analysis of the National COVID Cohort Collaborative Data Enclave.

Lily Cook, Juan Espinoza, Nicole G Weiskopf, Nisha Mathews, David A Dorr, Kelly L Gonzales, Adam Wilcox, Charisse Madlock-Brown, N3C Consortium

Open access · goldAbstract read
In one paragraph

Article in JMIR medical informatics, 2022. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 25 papers.

0numbers the graph read from it
0cells of the map it votes in
25citing papers in PubMed
3.9field-weighted citation impact, top 5% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

25 citing papers in PubMed, 39 citations in OpenAlex.

  1. Article
  2. Article
  3. Article
  4. Article
  5. Observational
  6. Article
  7. Article
  8. Article
  9. Article
  10. Article
  11. Article
  12. Article
  13. Article
  14. Article
  15. Article
  16. Applying Machine Learning Techniques to Implementation Science.Online journal of public health informatics · 2024
    Article
  17. Article
  18. Article
  19. Article
  20. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

9 authors at 6 institutions in 1 country.

Lily CookDepartment of Medical Informatics and Clinical Epidemiology, School of Medicine, Oregon Health & Science University, Portland, OR, United States.ORCID 0000-0002-2949-4978
Juan EspinozaDepartment of Pediatrics, Children's Hospital Los Angeles, Los Angeles, CA, United States.ORCID 0000-0003-0513-588X
Nicole G WeiskopfDepartment of Medical Informatics and Clinical Epidemiology, School of Medicine, Oregon Health & Science University, Portland, OR, United States.ORCID 0000-0003-0365-909X
Nisha MathewsCollege of Human Sciences and Humanities, University of Houston, Clear Lake-Pearland, TX, United States.ORCID 0000-0002-7115-5291
David A DorrDepartment of Medical Informatics and Clinical Epidemiology, School of Medicine, Oregon Health & Science University, Portland, OR, United States.ORCID 0000-0003-2318-7261
Kelly L GonzalesCitizen of the Cherokee Nation, Portland, OR, United States.ORCID 0000-0003-0541-9014
Adam WilcoxDepartment of Medicine, Institute for Informatics, Washington University in St. Louis, St. Louis, MO, United States.ORCID 0000-0002-6305-735X
Charisse Madlock-BrownTennessee Clinical and Translational Science Institute, University of Tennessee Health Science Center, Memphis, TN, United States.ORCID 0000-0002-3647-1045
N3C ConsortiumSee Acknowledgments, .
Oregon Health & Science University · USChildren's Hospital of Los Angeles · USPortland State University · USUniversity of Houston - Clear Lake · USUniversity of Tennessee Health Science Center · USWashington University in St. Louis · US

Funding

Southern California Clinical and Translational Science InstituteUL1TR001855 · NCATS · UNIVERSITY OF SOUTHERN CALIFORNIA · PI Thomas A Buchanan, Michele D. Kipke · 2016 to 2026
$81.3M
Southern California Clinical and Translational Science InstituteUL1TR000130 · NCATS · UNIVERSITY OF SOUTHERN CALIFORNIA · PI BUCHANAN, THOMAS A · 2012 to 2015
$36.0M
CD2H - The National COVID Cohort Collaborative (N3C) IDeA CTR CollaborationU24TR002306 · NCATS · UNIVERSITY OF COLORADO DENVER · PI CHUTE, CHRISTOPHER G, EICHMANN, DAVID A. · 2017 to 2021
$28.9M
TRAINING PROGRAM IN HEALTH INFORMATICST15LM007088 · NLM · OREGON HEALTH & SCIENCE UNIVERSITY · PI WILLIAM R HERSH, Vishnu Mohan · 1992 to 2026
$23.4M
Identifying and understanding drivers of selection bias and information bias in clinical COVID-19 dataR21LM013645 · NLM · OREGON HEALTH & SCIENCE UNIVERSITY · PI WEISKOPF, NICOLE GRAY · 2021 to 2022
$368k
NCATS NIH HHS U24 TR002306NCATS NIH HHS UL1 TR000130NCATS NIH HHS UL1 TR001855NLM NIH HHS R21 LM013645NLM NIH HHS T15 LM007088
6 · The paper itself

Abstract

backgroundThe adverse impact of COVID-19 on marginalized and under-resourced communities of color has highlighted the need for accurate, comprehensive race and ethnicity data. However, a significant technical challenge related to integrating race and ethnicity data in large, consolidated databases is the lack of consistency in how data about race and ethnicity are collected and structured by health care organizations.

objectiveThis study aims to evaluate and describe variations in how health care systems collect and report information about the race and ethnicity of their patients and to assess how well these data are integrated when aggregated into a large clinical database.

methodsAt the time of our analysis, the National COVID Cohort Collaborative (N3C) Data Enclave contained records from 6.5 million patients contributed by 56 health care institutions. We quantified the variability in the harmonized race and ethnicity data in the N3C Data Enclave by analyzing the conformance to health care standards for such data. We conducted a descriptive analysis by comparing the harmonized data available for research purposes in the database to the original source data contributed by health care institutions. To make the comparison, we tabulated the original source codes, enumerating how many patients had been reported with each encoded value and how many distinct ways each category was reported. The nonconforming data were also cross tabulated by 3 factors: patient ethnicity, the number of data partners using each code, and which data models utilized those particular encodings. For the nonconforming data, we used an inductive approach to sort the source encodings into categories. For example, values such as "Declined" were grouped with "Refused," and "Multiple Race" was grouped with "Two or more races" and "Multiracial."

results"No matching concept" was the second largest harmonized concept used by the N3C to describe the race of patients in their database. In addition, 20.7% of the race data did not conform to the standard; the largest category was data that were missing. Hispanic or Latino patients were overrepresented in the nonconforming racial data, and data from American Indian or Alaska Native patients were obscured. Although only a small proportion of the source data had not been mapped to the correct concepts (0.6%), Black or African American and Hispanic/Latino patients were overrepresented in this category.

conclusionsDifferences in how race and ethnicity data are conceptualized and encoded by health care institutions can affect the quality of the data in aggregated clinical databases. The impact of data quality issues in the N3C Data Enclave was not equal across all races and ethnicities, which has the potential to introduce bias in analyses and conclusions drawn from these data. Transparency about how data have been transformed can help users make accurate analyses and inferences and eventually better guide clinical care and public policy.

Indexed as

biasdata aggregationdata harmonizationdata qualitydata standardshealth equitysocial determinants of healthterminology

Identifiers

PMID35917481
PMCPMC9490543
OpenAlexW4288048604

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.