Evidence map›Paper›PMID 29335238›Full record

ArticleJMIR medical informatics2018

Automating Quality Measures for Heart Failure Using Natural Language Processing: A Descriptive Study in the Department of Veterans Affairs.

Jennifer Hornung Garvin, Youngjun Kim, Glenn Temple Gobbel, Michael E Matheny, Andrew Redd, Bruce E Bray, Paul Heidenreich, Dan Bolton, Julia Heavirland, Natalie Kelly and 4 more

Abstract read
In one paragraph

Article in JMIR medical informatics, 2018. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 24 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
24citing papers in PubMed, 1 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

24 citing papers in PubMed, 1 synthesis or guideline pooled it.

  1. Pooled it
  2. Article
  3. Article
  4. Review
  5. Article
  6. Review
  7. Article
  8. Review
  9. Artificial Intelligence Technologies in Cardiology.Journal of cardiovascular development and disease · 2023
    Review
  10. Combining text mining with clinical decision support in clinical practice: a scoping review.Journal of the American Medical Informatics Association : JAMIA · 2023
    Article
  11. Article
  12. Artificial intelligence and machine learning in precision and genomic medicine.Medical oncology (Northwood, London, England) · 2022
    Review
  13. Article
  14. Article
  15. Review
  16. Article
  17. Review
  18. Article
  19. Review
  20. Review
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

14 authors.

Jennifer Hornung GarvinHealth Information Management and Systems Division, School of Health and Rehabilitation Sciences, The Ohio State University, Columbus, OH, United States.ORCID http://orcid.org/0000-0002-8986-7211
Youngjun KimIDEAS 2.0 Health Services Research and Development Research Center, Salt Lake City Veterans Affairs Healthcare System, Department of Veterans Affairs, Salt Lake City, UT, United States.ORCID http://orcid.org/0000-0001-9085-6686
Glenn Temple GobbelGeriatric Research, Education and Clinical Center, Tennessee Valley Healthcare System, Department of Veterans Affairs, Nashville, TN, United States.ORCID http://orcid.org/0000-0002-5368-7737
Michael E MathenyGeriatric Research, Education and Clinical Center, Tennessee Valley Healthcare System, Department of Veterans Affairs, Nashville, TN, United States.ORCID http://orcid.org/0000-0003-3217-4147
Andrew ReddIDEAS 2.0 Health Services Research and Development Research Center, Salt Lake City Veterans Affairs Healthcare System, Department of Veterans Affairs, Salt Lake City, UT, United States.ORCID http://orcid.org/0000-0002-6149-2438
Bruce E BrayIDEAS 2.0 Health Services Research and Development Research Center, Salt Lake City Veterans Affairs Healthcare System, Department of Veterans Affairs, Salt Lake City, UT, United States.ORCID http://orcid.org/0000-0003-3963-2964
Paul HeidenreichPalo Alto Geriatric Research, Education and Clinical Center, Veterans Affairs Palo Alto Health Care System, Department of Veterans Affairs, Stanford University, Palo Alto, CA, United States.ORCID http://orcid.org/0000-0001-7730-8490
Dan BoltonIDEAS 2.0 Health Services Research and Development Research Center, Salt Lake City Veterans Affairs Healthcare System, Department of Veterans Affairs, Salt Lake City, UT, United States.ORCID http://orcid.org/0000-0003-0759-692X
Julia HeavirlandIDEAS 2.0 Health Services Research and Development Research Center, Salt Lake City Veterans Affairs Healthcare System, Department of Veterans Affairs, Salt Lake City, UT, United States.ORCID http://orcid.org/0000-0001-6998-4093
Natalie KellyIDEAS 2.0 Health Services Research and Development Research Center, Salt Lake City Veterans Affairs Healthcare System, Department of Veterans Affairs, Salt Lake City, UT, United States.ORCID http://orcid.org/0000-0001-8183-6704
Ruth ReevesGeriatric Research, Education and Clinical Center, Tennessee Valley Healthcare System, Department of Veterans Affairs, Nashville, TN, United States.ORCID http://orcid.org/0000-0003-4260-2707
Megha KalsyIDEAS 2.0 Health Services Research and Development Research Center, Salt Lake City Veterans Affairs Healthcare System, Department of Veterans Affairs, Salt Lake City, UT, United States.ORCID http://orcid.org/0000-0001-7604-3558
Mary Kane GoldsteinMedical Service, Veterans Affairs Palo Alto Health Care System, Palo Alto, CA, United States.ORCID http://orcid.org/0000-0001-7256-5746
Stephane M MeystreIDEAS 2.0 Health Services Research and Development Research Center, Salt Lake City Veterans Affairs Healthcare System, Department of Veterans Affairs, Salt Lake City, UT, United States.ORCID http://orcid.org/0000-0002-7632-9625

Funding

HSRD VA IBE 09-069
6 · The paper itself

Abstract

backgroundWe developed an accurate, stakeholder-informed, automated, natural language processing (NLP) system to measure the quality of heart failure (HF) inpatient care, and explored the potential for adoption of this system within an integrated health care system.

objectiveTo accurately automate a United States Department of Veterans Affairs (VA) quality measure for inpatients with HF.

methodsWe automated the HF quality measure Congestive Heart Failure Inpatient Measure 19 (CHI19) that identifies whether a given patient has left ventricular ejection fraction (LVEF) <40%, and if so, whether an angiotensin-converting enzyme inhibitor or angiotensin-receptor blocker was prescribed at discharge if there were no contraindications. We used documents from 1083 unique inpatients from eight VA medical centers to develop a reference standard (RS) to train (n=314) and test (n=769) the Congestive Heart Failure Information Extraction Framework (CHIEF). We also conducted semi-structured interviews (n=15) for stakeholder feedback on implementation of the CHIEF.

resultsThe CHIEF classified each hospitalization in the test set with a sensitivity (SN) of 98.9% and positive predictive value of 98.7%, compared with an RS and SN of 98.5% for available External Peer Review Program assessments. Of the 1083 patients available for the NLP system, the CHIEF evaluated and classified 100% of cases. Stakeholders identified potential implementation facilitators and clinical uses of the CHIEF.

conclusionsThe CHIEF provided complete data for all patients in the cohort and could potentially improve the efficiency, timeliness, and utility of HF quality measurements.

Indexed as

heart failureinformaticsleft ventricular ejection fraction (EF)natural language processing (NLP)quality measures

Identifiers

PMID29335238
PMCPMC5789165

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.