Evidence map›Paper›PMID 34957491›Full record

ArticleJournal of the American Medical Informatics Association : JAMIA2022

Indication alerts to improve problem list documentation.

Anne Grauer, Jerard Kneifati-Hayek, Brian Reuland, Jo R Applebaum, Jason S Adelman, Robert A Green, Jeanette Lisak-Phillips, David Liebovitz, Thomas F Byrd, Preeti Kansal and 8 more

Abstract read
In one paragraph

Article in Journal of the American Medical Informatics Association : JAMIA, 2022. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 6 papers.

0numbers the graph read from it
0cells of the map it votes in
6citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

6 citing papers in PubMed.

  1. Article
  2. Article
  3. Article
  4. Improved Diabetes Screening for Women After Gestational Diabetes Mellitus.Diabetes spectrum : a publication of the American Diabetes Association · 2025
    Article
  5. Article
  6. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

18 authors.

Anne GrauerDepartment of Medicine, Columbia University Irving Medical Center, New York City, New York, USA.
Jerard Kneifati-HayekDepartment of Medicine, Columbia University Irving Medical Center, New York City, New York, USA.
Brian ReulandDepartment of Medicine, Columbia University Irving Medical Center, New York City, New York, USA.
Jo R ApplebaumDepartment of Quality and Patient Safety, New York-Presbyterian Hospital, New York City, New York, USA.ORCID 0000-0002-4137-6069
Jason S AdelmanDepartment of Medicine, Columbia University Irving Medical Center, New York City, New York, USA.
Robert A GreenDepartment of Medicine, Columbia University Irving Medical Center, New York City, New York, USA.
Jeanette Lisak-PhillipsDepartment of Medicine, Columbia University Irving Medical Center, New York City, New York, USA.
David LiebovitzDepartment of Medicine, Northwestern University, Chicago, Illinois, USA.
Thomas F ByrdDepartment of Medicine, Northwestern University, Chicago, Illinois, USA.
Preeti KansalDepartment of Medicine, Northwestern University, Chicago, Illinois, USA.
Cheryl WilkesDepartment of Medicine, Northwestern University, Chicago, Illinois, USA.
Suzanne FalckDepartment of Medicine, University of Illinois at Chicago, Chicago, Illinois, USA.
Connie LarsonDepartment of Pharmacy Practice, University of Illinois at Chicago, Chicago, Illinois, USA.
John ShilkaDepartment of Pharmacy Practice, University of Illinois at Chicago, Chicago, Illinois, USA.
Elizabeth VanDrilDepartment of Pharmacy Practice, University of Illinois at Chicago, Chicago, Illinois, USA.
Gordon D SchiffBrigham and Women's Hospital Center for Patient Safety Research, Harvard Medical School Center for Primary Care, Boston, Massachusetts, USA.
William L GalanterDepartment of Medicine, University of Illinois at Chicago, Chicago, Illinois, USA.
Bruce L LambertCenter for Communication and Health, Department of Communication Studies, Northwestern University, Chicago, Illinois, USA.

Funding

Patient Safety and Health Services Research TrainingT32HS026121 · AHRQ · COLUMBIA UNIVERSITY HEALTH SCIENCES · PI ADELMAN, JASON STUART, BARR, R GRAHAM · 2018 to 2024
$2.4M
Preventing Wrong-Drug and Wrong-Patient Errors with Indication Alerts in CPOE SystemsR01HS024945 · AHRQ · NORTHWESTERN UNIVERSITY · PI LAMBERT, BRUCE L. · 2016 to 2020
$2.0M
Agency for Healthcare Research and QualityAHRQ HHS R01 HS024945AHRQ HHS T32 HS026121
6 · The paper itself

Abstract

backgroundProblem lists represent an integral component of high-quality care. However, they are often inaccurate and incomplete. We studied the effects of alerts integrated into the inpatient and outpatient computerized provider order entry systems to assist in adding problems to the problem list when ordering medications that lacked a corresponding indication.

methodsWe analyzed medication orders from 2 healthcare systems that used an innovative indication alert. We collected data at site 1 between December 2018 and January 2020, and at site 2 between May and June 2021. We reviewed random samples of 100 charts from each site that had problems added in response to the alert. Outcomes were: (1) alert yield, the proportion of triggered alerts that led to a problem added and (2) problem accuracy, the proportion of problems placed that were accurate by chart review.

resultsAlerts were triggered 131 134, and 6178 times at sites 1 and 2, respectively, resulting in a yield of 109 055 (83.2%) and 2874 (46.5%), P< .001. Orders were abandoned, for example, not completed, in 11.1% and 9.6% of orders, respectively, P<.001. Of the 100 sample problems, reviewers deemed 88% ± 3% and 91% ± 3% to be accurate, respectively, P = .65, with a mean of 90% ± 2%.

conclusionsIndication alerts triggered by medication orders initiated in the absence of a justifying diagnosis were useful for populating problem lists, with yields of 83.2% and 46.5% at 2 healthcare systems. Problems were placed with a reasonable level of accuracy, with 90% ± 2% of problems deemed accurate based on chart review.

Indexed as

Decision Support Systems, ClinicalMedical Order Entry SystemsDocumentationHumansInpatientsMedication Errorsclinicaldecision support systemsindication-based prescribingmedical recordsproblem listproblem-oriented

Identifiers

PMID34957491
PMCPMC9006708

What OpenQuestion holds

Textmetadata
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.