Evidence map›Paper›PMID 37558448›Full record

ArticleBMJ open2023

Retrospective comparison of traditional and artificial intelligence-based heart failure phenotyping in a US health system to enable real-world evidence.

Arthur Reshad Garan, Keri L Monda, Ricardo E Dent-Acosta, Daniel J Riskin, Ty J Gluckman

Open access · goldAbstract read
In one paragraph

Article in BMJ open, 2023. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 5 papers.

0numbers the graph read from it
0cells of the map it votes in
5citing papers in PubMed
0.9field-weighted citation impact, top 23% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

5 citing papers in PubMed, 4 citations in OpenAlex.

  1. Beyond the Classics: The Synergy of AI and Genomics Reveals an Expanded Repertoire of Pigmentation Genes.Journal of experimental zoology. Part B, Molecular and developmental evolution · 2026
    Review
  2. Review
  3. Article
  4. Article
  5. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

5 authors at 4 institutions in 1 country.

Arthur Reshad GaranBeth Israel Deaconess Medical Center, Department of Medicine, Division of Cardiology, Harvard Medical School, Boston, Massachusetts, USA agaran@bidmc.harvard.edu.ORCID 0000-0001-7510-075X
Keri L MondaAmgen Inc, Thousand Oaks, California, USA.
Ricardo E Dent-AcostaAmgen Inc, Thousand Oaks, California, USA.
Daniel J RiskinVerantos, Menlo Park, California, USA.
Ty J GluckmanCenter for Cardiovascular Analytics, Research and Data Science (CARDS), Providence Heart Institute, Providence Research Network, Portland, Oregon, USA.
Amgen (United States) · USBeth Israel Deaconess Medical Center · USMenlo School · USProvidence College · US

Funding

Transforming Real-world evidence with Unstructured and Structured data to advance Tailored therapy (TRUST)U01FD007172 · FDA · VERANTOS, INC. · PI RISKIN, DANIEL JAY · 2020 to 2022
$5.7M
Leveraging advanced clinical phenotyping to enhance problem lists and support value-based healthcareR44TR002437 · NCATS · VMT, INC. · PI RISKIN, DANIEL JAY · 2018 to 2019
$1.5M
FDA HHS U01 FD007172NCATS NIH HHS R44 TR002437
6 · The paper itself

Abstract

objectiveQuantitatively evaluate the quality of data underlying real-world evidence (RWE) in heart failure (HF).

designRetrospective comparison of accuracy in identifying patients with HF and phenotypic information was made using traditional (ie, structured query language applied to structured electronic health record (EHR) data) and advanced (ie, artificial intelligence (AI) applied to unstructured EHR data) RWE approaches. The performance of each approach was measured by the harmonic mean of precision and recall (F

settingEHR data from a large academic healthcare system in North America between 2015 and 2019, with an expected catchment of approximately 5 00 000 patients. POPULATION: 4288 encounters for 1155 patients aged 18-85 years, with 472 patients identified as having HF. OUTCOME MEASURES: HF and associated concepts, such as comorbidities, left ventricular ejection fraction, and selected medications.

resultsThe average F

conclusionsA traditional RWE generation approach resulted in low data quality in patients with HF. While an advanced approach demonstrated high accuracy, the results varied dramatically based on extraction techniques. For future studies, advanced approaches and accuracy measurement may be required to ensure data are fit-for-purpose.

Indexed as

Artificial IntelligenceHeart FailureElectronic Health RecordsHumansNatural Language ProcessingRetrospective StudiesStroke VolumeVentricular Function, Leftcardiac epidemiologyhealth informaticsheart failure

Identifiers

PMID37558448
PMCPMC10414071
OpenAlexW4385690559

What OpenQuestion holds

Textmetadata
LicenceCC BY-NC
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.