Evidence map›Paper›PMID 34347314›Full record

ArticleClinical cardiology2021

Natural language processing for the assessment of cardiovascular disease comorbidities: The cardio-Canary comorbidity project.

Adam N Berman, David W Biery, Curtis Ginder, Olivia L Hulme, Daniel Marcusa, Orly Leiva, Wanda Y Wu, Nicholas Cardin, Jon Hainer, Deepak L Bhatt and 3 more

Abstract read
In one paragraph

Article in Clinical cardiology, 2021. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 20 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
20citing papers in PubMed, 1 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

20 citing papers in PubMed, 1 synthesis or guideline pooled it.

  1. How to assess multimorbidity: a systematic review.Frontiers in public health · 2025
    Pooled it
  2. Review
  3. Review
  4. Article
  5. Aortic valve replacement and mortality in asymptomatic individuals with severe aortic stenosis and left ventricular hypertrophy.European journal of cardio-thoracic surgery : official journal of the European Association for Cardio-thoracic Surgery · 2025
    Article
  6. Article
  7. Article
  8. Article
  9. Review
  10. Article
  11. Article
  12. Article
  13. Article
  14. Article
  15. Review
  16. Article
  17. Article
  18. Survey on natural language processing in medical image analysis.Zhong nan da xue xue bao. Yi xue ban = Journal of Central South University. Medical sciences · 2022
    Article
  19. Article
  20. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

13 authors.

Adam N BermanCardiovascular Division, Department of Medicine, Brigham and Women's Hospital, Harvard Medical School, Boston, Massachusetts, USA.ORCID https://orcid.org/0000-0002-0724-9779
David W BieryCardiovascular Division, Department of Medicine, Brigham and Women's Hospital, Harvard Medical School, Boston, Massachusetts, USA.
Curtis GinderDepartment of Medicine, Brigham and Women's Hospital, Harvard Medical School, Boston, Massachusetts, USA.
Olivia L HulmeDepartment of Medicine, Brigham and Women's Hospital, Harvard Medical School, Boston, Massachusetts, USA.
Daniel MarcusaDepartment of Medicine, Brigham and Women's Hospital, Harvard Medical School, Boston, Massachusetts, USA.
Orly LeivaDepartment of Medicine, Brigham and Women's Hospital, Harvard Medical School, Boston, Massachusetts, USA.
Wanda Y WuCardiovascular Division, Department of Medicine, Brigham and Women's Hospital, Harvard Medical School, Boston, Massachusetts, USA.
Nicholas CardinDivision of Endocrinology, Department of Medicine, Brigham and Women's Hospital, Harvard Medical School, Boston, Massachusetts, USA.
Jon HainerDepartment of Radiology, Brigham and Women's Hospital, Harvard Medical School, Boston, Massachusetts, USA.ORCID https://orcid.org/0000-0002-0572-912X
Deepak L BhattCardiovascular Division, Department of Medicine, Brigham and Women's Hospital, Harvard Medical School, Boston, Massachusetts, USA.ORCID https://orcid.org/0000-0002-1278-6245
Marcelo F Di CarliCardiovascular Division, Department of Medicine, Brigham and Women's Hospital, Harvard Medical School, Boston, Massachusetts, USA.
Alexander TurchinDivision of Endocrinology, Department of Medicine, Brigham and Women's Hospital, Harvard Medical School, Boston, Massachusetts, USA.
Ron BlanksteinCardiovascular Division, Department of Medicine, Brigham and Women's Hospital, Harvard Medical School, Boston, Massachusetts, USA.

Funding

Noninvasive Cardiovascular Imaging Research Training ProgramT32HL094301 · NHLBI · BRIGHAM AND WOMEN'S HOSPITAL · PI Marcelo F DI CARLI · 2010 to 2026
$7.8M
NHLBI NIH HHS T32 HL094301
6 · The paper itself

Abstract

objectiveAccurate ascertainment of comorbidities is paramount in clinical research. While manual adjudication is labor-intensive and expensive, the adoption of electronic health records enables computational analysis of free-text documentation using natural language processing (NLP) tools. HYPOTHESIS: We sought to develop highly accurate NLP modules to assess for the presence of five key cardiovascular comorbidities in a large electronic health record system.

methodsOne-thousand clinical notes were randomly selected from a cardiovascular registry at Mass General Brigham. Trained physicians manually adjudicated these notes for the following five diagnostic comorbidities: hypertension, dyslipidemia, diabetes, coronary artery disease, and stroke/transient ischemic attack. Using the open-source Canary NLP system, five separate NLP modules were designed based on 800 "training-set" notes and validated on 200 "test-set" notes.

resultsAcross the five NLP modules, the sentence-level and note-level sensitivity, specificity, and positive predictive value was always greater than 85% and was most often greater than 90%. Accuracy tended to be highest for conditions with greater diagnostic clarity (e.g. diabetes and hypertension) and slightly lower for conditions whose greater diagnostic challenges (e.g. myocardial infarction and embolic stroke) may lead to less definitive documentation.

conclusionWe designed five open-source and highly accurate NLP modules that can be used to assess for the presence of important cardiovascular comorbidities in free-text health records. These modules have been placed in the public domain and can be used for clinical research, trial recruitment and population management at any institution as well as serve as the basis for further development of cardiovascular NLP tools.

Indexed as

Cardiovascular DiseasesNatural Language ProcessingAlgorithmsComorbidityElectronic Health RecordsHumanscardiovascular comorbiditiesnatural language processing

Identifiers

PMID34347314
PMCPMC8428009

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.