Evidence map›Paper›PMID 31329882›Full record

Observational studyJournal of the American Medical Informatics Association : JAMIA2019

Underserved populations with missing race ethnicity data differ significantly from those with structured race/ethnicity documentation.

Evan T Sholle, Laura C Pinheiro, Prakash Adekkanattu, Marcos A Davila, Stephen B Johnson, Jyotishman Pathak, Sanjai Sinha, Cassidie Li, Stasi A Lubansky, Monika M Safford and 1 more

Abstract readObservational Study
In one paragraph

Observational study in Journal of the American Medical Informatics Association : JAMIA, 2019. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 49 papers, 5 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
49citing papers in PubMed, 5 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

49 citing papers in PubMed, 5 syntheses or guidelines pooled it.

  1. Pooled it
  2. Electronic health record data quality assessment and tools: a systematic review.Journal of the American Medical Informatics Association : JAMIA · 2023
    Pooled it
  3. Pooled it
  4. The quality of social determinants data in the electronic health record: a systematic review.Journal of the American Medical Informatics Association : JAMIA · 2021
    Pooled it
  5. Pooled it
  6. Trial
  7. Article
  8. Article
  9. Racial disparities in multiple sclerosis quality of care metrics.Multiple sclerosis (Houndmills, Basingstoke, England) · 2026
    Article
  10. Article
  11. Article
  12. Article
  13. Article
  14. Article
  15. Review
  16. Article
  17. Article
  18. Article
  19. Article
  20. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

11 authors.

Evan T SholleInformation Technologies & Services Department, Weill Cornell Medicine, New York, New York, USA.
Laura C PinheiroDepartment of Medicine, Weill Cornell Medicine, New York, New York, USA.
Prakash AdekkanattuInformation Technologies & Services Department, Weill Cornell Medicine, New York, New York, USA.
Marcos A DavilaInformation Technologies & Services Department, Weill Cornell Medicine, New York, New York, USA.
Stephen B JohnsonDepartment of Healthcare Policy & Research, Weill Cornell Medicine, New York, New York, USA.
Jyotishman PathakDepartment of Healthcare Policy & Research, Weill Cornell Medicine, New York, New York, USA.
Sanjai SinhaDepartment of Medicine, Weill Cornell Medicine, New York, New York, USA.
Cassidie LiDepartment of Medicine, Weill Cornell Medicine, New York, New York, USA.
Stasi A LubanskyDepartment of Medicine, Weill Cornell Medicine, New York, New York, USA.
Monika M SaffordDepartment of Medicine, Weill Cornell Medicine, New York, New York, USA.
Thomas R CampionInformation Technologies & Services Department, Weill Cornell Medicine, New York, New York, USA.

Funding

Disparities in COVID Disease Severity and Outcomes in New York CityUL1TR002384 · NCATS · WEILL MEDICAL COLL OF CORNELL UNIV · PI JULIANNE L IMPERATO-MCGINLEY · 2017 to 2026
$86.2M
Clinical and Translational Science CenterUL1TR000457 · NCATS · WEILL MEDICAL COLL OF CORNELL UNIV · PI IMPERATO-MCGINLEY, JULIANNE L · 2012 to 2016
$46.0M
National Infrastructure for Standardized and Portable EHR Phenotyping AlgorithmsR01GM105688 · NIGMS · WEILL MEDICAL COLL OF CORNELL UNIV · PI LUO, YUAN, PATHAK, JYOTISHMAN · 2013 to 2020
$5.7M
Modeling Social Behavior for Healthcare Utilization in DepressionR01MH105384 · NIMH · WEILL MEDICAL COLL OF CORNELL UNIV · PI PATHAK, JYOTISHMAN, SHETH, AMIT P · 2015 to 2018
$2.1M
NCATS NIH HHS UL1 TR000457NCATS NIH HHS UL1 TR002384NIGMS NIH HHS R01 GM105688NIMH NIH HHS R01 MH105384
6 · The paper itself

Abstract

objectiveWe aimed to address deficiencies in structured electronic health record (EHR) data for race and ethnicity by identifying black and Hispanic patients from unstructured clinical notes and assessing differences between patients with or without structured race/ethnicity data. MATERIALS AND

methodsUsing EHR notes for 16 665 patients with encounters at a primary care practice, we developed rule-based natural language processing (NLP) algorithms to classify patients as black/Hispanic. We evaluated performance of the method against an annotated gold standard, compared race and ethnicity between NLP-derived and structured EHR data, and compared characteristics of patients identified as black or Hispanic using only NLP vs patients identified as such only in structured EHR data.

resultsFor the sample of 16 665 patients, NLP identified 948 additional patients as black, a 26%increase, and 665 additional patients as Hispanic, a 20% increase. Compared with the patients identified as black or Hispanic in structured EHR data, patients identified as black or Hispanic via NLP only were older, more likely to be male, less likely to have commercial insurance, and more likely to have higher comorbidity. DISCUSSION: Structured EHR data for race and ethnicity are subject to data quality issues. Supplementing structured EHR race data with NLP-derived race and ethnicity may allow researchers to better assess the demographic makeup of populations and draw more accurate conclusions about intergroup differences in health outcomes.

conclusionsBlack or Hispanic patients who are not documented as such in structured EHR race/ethnicity fields differ significantly from those who are. Relatively simple NLP can help address this limitation.

Indexed as

Black or African AmericanElectronic Health RecordsHispanic or LatinoNatural Language ProcessingVulnerable PopulationsAlgorithmsCross-Sectional StudiesEthnicityFemaleHumansMaleRacial Groupselectronic health recordethnicitynatural language processingrace

Identifiers

PMID31329882
PMCPMC6696506

What OpenQuestion holds

Textmetadata
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.