Evidence map›Paper›PMID 35396454›Full record

ArticleNPJ digital medicine2022

Cohort design and natural language processing to reduce bias in electronic health records research.

Shaan Khurshid, Christopher Reeder, Lia X Harrington, Pulkit Singh, Gopal Sarma, Samuel F Friedman, Paolo Di Achille, Nathaniel Diamant, Jonathan W Cunningham, Ashby C Turner and 19 more

Open access · goldAbstract read
In one paragraph

Article in NPJ digital medicine, 2022. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 53 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
53citing papers in PubMed, 1 pooled it
9.7field-weighted citation impact, top 2% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

53 citing papers in PubMed, 1 synthesis or guideline pooled it, 78 citations in OpenAlex.

  1. Pooled it
  2. Trial
  3. ECG-Based Deep Learning to Predict Incident Atrial Fibrillation Burden.Journal of the American Heart Association · 2026
    Article
  4. Article
  5. Article
  6. Review
  7. Article
  8. Article
  9. Article
  10. Article
  11. Article
  12. Article
  13. Article
  14. Article
  15. Article
  16. Article
  17. Article
  18. Article
  19. Observational
  20. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

29 authors at 5 institutions in 2 countries.

Shaan Khurshid *Division of Cardiology, Massachusetts General Hospital, Boston, MA, USA.
Christopher Reeder *Data Sciences Platform, Broad Institute of Harvard and the Massachusetts Institute of Technology, Cambridge, MA, USA.
Lia X HarringtonCardiovascular Research Center, Massachusetts General Hospital, Boston, MA, USA.
Pulkit SinghData Sciences Platform, Broad Institute of Harvard and the Massachusetts Institute of Technology, Cambridge, MA, USA.
Gopal SarmaData Sciences Platform, Broad Institute of Harvard and the Massachusetts Institute of Technology, Cambridge, MA, USA.
Samuel F FriedmanData Sciences Platform, Broad Institute of Harvard and the Massachusetts Institute of Technology, Cambridge, MA, USA.
Paolo Di AchilleData Sciences Platform, Broad Institute of Harvard and the Massachusetts Institute of Technology, Cambridge, MA, USA.ORCID http://orcid.org/0000-0001-9256-0678
Nathaniel DiamantData Sciences Platform, Broad Institute of Harvard and the Massachusetts Institute of Technology, Cambridge, MA, USA.ORCID http://orcid.org/0000-0002-1738-304X
Jonathan W CunninghamCardiovascular Disease Initiative, Broad Institute of Harvard and the Massachusetts Institute of Technology, Cambridge, MA, USA.ORCID http://orcid.org/0000-0003-4481-7867
Ashby C TurnerDepartment of Neurology, Massachusetts General Hospital, Boston, MA, USA.
Emily S LauDivision of Cardiology, Massachusetts General Hospital, Boston, MA, USA.
Julian S HaimovichCardiovascular Research Center, Massachusetts General Hospital, Boston, MA, USA.
Mostafa A Al-AlusiDivision of Cardiology, Massachusetts General Hospital, Boston, MA, USA.
Xin WangCardiovascular Research Center, Massachusetts General Hospital, Boston, MA, USA.
Marcus D R KlarqvistData Sciences Platform, Broad Institute of Harvard and the Massachusetts Institute of Technology, Cambridge, MA, USA.ORCID http://orcid.org/0000-0001-7630-2708
Jeffrey M AshburnerHarvard Medical School, Boston, MA, USA.
Christian DiedrichBayer AG, Research and Development, Pharmaceuticals, Leverkusen, Germany.
Mercedeh GhadessiBayer AG, Research and Development, Pharmaceuticals, Leverkusen, Germany.
Johanna MielkeBayer AG, Research and Development, Pharmaceuticals, Leverkusen, Germany.
Hanna M EilkenBayer AG, Research and Development, Pharmaceuticals, Leverkusen, Germany.
Alice McElhinneyCardiovascular Disease Initiative, Broad Institute of Harvard and the Massachusetts Institute of Technology, Cambridge, MA, USA.
Andrea DerixBayer AG, Research and Development, Pharmaceuticals, Leverkusen, Germany.
Steven J AtlasHarvard Medical School, Boston, MA, USA.
Patrick T EllinorCardiovascular Research Center, Massachusetts General Hospital, Boston, MA, USA.ORCID http://orcid.org/0000-0002-2067-0533
Anthony A PhilippakisData Sciences Platform, Broad Institute of Harvard and the Massachusetts Institute of Technology, Cambridge, MA, USA.
Christopher D AndersonCardiovascular Research Center, Massachusetts General Hospital, Boston, MA, USA.
Jennifer E HoDivision of Cardiology, Massachusetts General Hospital, Boston, MA, USA.ORCID http://orcid.org/0000-0002-7987-4768
Puneet BatraData Sciences Platform, Broad Institute of Harvard and the Massachusetts Institute of Technology, Cambridge, MA, USA.ORCID http://orcid.org/0000-0001-6822-0593
Steven A LubitzCardiovascular Research Center, Massachusetts General Hospital, Boston, MA, USA. slubitz@mgh.harvard.edu.ORCID http://orcid.org/0000-0002-9599-4866
Broad Institute · USBayer (Germany) · DEMassachusetts General Hospital · USHarvard University · USBrigham and Women's Hospital · US

Funding

IDENTIFICATION OF COMMON GENETIC VARIANTS FOR ATRIAL FIBRILLATION AND PR INTERVALR01HL092577 · NHLBI · MASSACHUSETTS GENERAL HOSPITAL · PI BENJAMIN, EMELIA J., ELLINOR, PATRICK THOMAS · 2009 to 2025
$20.6M
MULTIDISCIPLINARY RESEARCH TRAINING IN CARDIOLOGYT32HL007208 · NHLBI · MASSACHUSETTS GENERAL HOSPITAL · PI Patrick Thomas Ellinor, David E Sosnovik · 1985 to 2026
$16.1M
Noninvasive Cardiovascular Imaging Research Training ProgramT32HL094301 · NHLBI · BRIGHAM AND WOMEN'S HOSPITAL · PI Marcelo F DI CARLI · 2010 to 2026
$7.8M
Sequencing Annotation and Functional Analysis in Risk of Intracerebral HemorrhageR01NS103924 · NINDS · MASSACHUSETTS GENERAL HOSPITAL · PI ANDERSON, CHRISTOPHER DAVID · 2018 to 2022
$3.4M
Genomics of Cardiac ArrhythmiasR01HL139731 · NHLBI · MASSACHUSETTS GENERAL HOSPITAL · PI ELLINOR, PATRICK THOMAS · 2018 to 2022
$3.3M
AFGen Consortium: Atrial Fibrillation Genomics to Functional AnalysesR01HL128914 · NHLBI · BOSTON UNIVERSITY MEDICAL CAMPUS · PI BENJAMIN, EMELIA J., ELLINOR, PATRICK THOMAS · 2015 to 2018
$3.1M
Eicosanoid Profiles as Determinants of HFpEFR01HL140224 · NHLBI · MASSACHUSETTS GENERAL HOSPITAL · PI HO, JENNIFER E · 2018 to 2021
$3.1M
The Association of Metabolic Disease and Pulmonary HypertensionR01HL134893 · NHLBI · MASSACHUSETTS GENERAL HOSPITAL · PI HO, JENNIFER E · 2017 to 2021
$2.9M
MGH Next Generation Physician-Scientist Through Stimulating Access to Research in Residency Program (MGH-Next Gen StARR)R38HL150212 · NHLBI · MASSACHUSETTS GENERAL HOSPITAL · PI VYAS, JATIN M · 2020 to 2023
$1.3M
Mentoring in Arrhythmia ResearchK24HL105780 · NHLBI · MASSACHUSETTS GENERAL HOSPITAL · PI ELLINOR, PATRICK THOMAS · 2011 to 2020
$1.2M
HFpEF Susceptibility in Women: The Role of InflammationK23HL159243 · NHLBI · MASSACHUSETTS GENERAL HOSPITAL · PI Emily Lau · 2022 to 2026
$1.1M
Identifying primary care patients at increased risk of atrial fibrillation for screening interventionsK01HL148506 · NHLBI · MASSACHUSETTS GENERAL HOSPITAL · PI ASHBURNER, JEFFREY M · 2019 to 2023
$887k
American Heart Association-American Stroke Association 18SFRN34110082American Heart Association-American Stroke Association 18SFRN34250007NHLBI NIH HHS K01 HL148506NHLBI NIH HHS K23 HL159243NHLBI NIH HHS K24 HL105780NHLBI NIH HHS K24 HL153669NHLBI NIH HHS R01 HL092577NHLBI NIH HHS R01 HL128914NHLBI NIH HHS R01 HL134893NHLBI NIH HHS R01 HL139731NHLBI NIH HHS R01 HL140224NHLBI NIH HHS R38 HL150212NHLBI NIH HHS T32 HL007208NHLBI NIH HHS T32 HL094301NINDS NIH HHS R01 NS103924
6 · The paper itself

Abstract

Electronic health record (EHR) datasets are statistically powerful but are subject to ascertainment bias and missingness. Using the Mass General Brigham multi-institutional EHR, we approximated a community-based cohort by sampling patients receiving longitudinal primary care between 2001-2018 (Community Care Cohort Project [C3PO], n = 520,868). We utilized natural language processing (NLP) to recover vital signs from unstructured notes. We assessed the validity of C3PO by deploying established risk models for myocardial infarction/stroke and atrial fibrillation. We then compared C3PO to Convenience Samples including all individuals from the same EHR with complete data, but without a longitudinal primary care requirement. NLP reduced the missingness of vital signs by 31%. NLP-recovered vital signs were highly correlated with values derived from structured fields (Pearson r range 0.95-0.99). Atrial fibrillation and myocardial infarction/stroke incidence were lower and risk models were better calibrated in C3PO as opposed to the Convenience Samples (calibration error range for myocardial infarction/stroke: 0.012-0.030 in C3PO vs. 0.028-0.046 in Convenience Samples; calibration error for atrial fibrillation 0.028 in C3PO vs. 0.036 in Convenience Samples). Sampling patients receiving regular primary care and using NLP to recover missing data may reduce bias and maximize generalizability of EHR research.

Identifiers

PMID35396454
PMCPMC8993873
OpenAlexW4223532457

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.