Evidence map›Paper›PMID 36806929›Full record

Trial reportJournal of the American Medical Informatics Association : JAMIA2023

A multi-site randomized trial of a clinical decision support intervention to improve problem list completeness.

Adam Wright, Richard Schreiber, David W Bates, Skye Aaron, Angela Ai, Raja Arul Cholan, Akshay Desai, Miguel Divo, David A Dorr, Thu-Trang Hickman and 10 more

Abstract readRandomized Controlled Trial
In one paragraph

Trial report in Journal of the American Medical Informatics Association : JAMIA, 2023. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 3 papers.

0numbers the graph read from it
0cells of the map it votes in
3citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

3 citing papers in PubMed.

  1. Article
  2. Review
  3. Alert acceptance: are all acceptance rates the same?Journal of the American Medical Informatics Association : JAMIA · 2023
    Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

20 authors.

Adam WrightDepartment of Biomedical Informatics, Vanderbilt University Medical Center, Nashville, Tennessee, USA.ORCID 0000-0001-6844-145X
Richard SchreiberPhysician Informatics and Department of Internal Medicine, Penn State Health Holy Spirit Medical Center, Camp Hill, Pennsylvania, USA.ORCID 0000-0002-6138-7048
David W BatesDepartment of Medicine, Brigham and Women's Hospital, Boston, Massachusetts, USA.ORCID 0000-0001-6268-1540
Skye AaronDepartment of Medicine, Brigham and Women's Hospital, Boston, Massachusetts, USA.
Angela AiDepartment of Medicine, Brigham and Women's Hospital, Boston, Massachusetts, USA.ORCID 0000-0002-6064-4700
Raja Arul CholanDepartment of Medical Informatics and Clinical Epidemiology, Oregon Health and Science University, Portland, Oregon, USA.
Akshay DesaiDepartment of Medicine, Brigham and Women's Hospital, Boston, Massachusetts, USA.
Miguel DivoDepartment of Medicine, Brigham and Women's Hospital, Boston, Massachusetts, USA.
David A DorrDepartment of Medical Informatics and Clinical Epidemiology, Oregon Health and Science University, Portland, Oregon, USA.ORCID 0000-0003-2318-7261
Thu-Trang HickmanDepartment of Medicine, Brigham and Women's Hospital, Boston, Massachusetts, USA.
Salman HussainDepartment of Medicine, Brigham and Women's Hospital, Boston, Massachusetts, USA.
Shari JustHealthIT, Vanderbilt University Medical Center, Nashville, Tennessee, USA.
Brian KohDepartment of Biomedical Informatics, Vanderbilt University Medical Center, Nashville, Tennessee, USA.
Stuart LipsitzDepartment of Medicine, Brigham and Women's Hospital, Boston, Massachusetts, USA.
Dustin McevoyDigital, Mass General Brigham, Boston, Massachusetts, USA.
Trent RosenbloomDepartment of Biomedical Informatics, Vanderbilt University Medical Center, Nashville, Tennessee, USA.ORCID 0000-0001-7455-2260
Elise RussoDepartment of Biomedical Informatics, Vanderbilt University Medical Center, Nashville, Tennessee, USA.
David Yut-Chee TingMassachusetts General Hospital, Boston, Massachusetts, USA.
Asli WeitkampDepartment of Biomedical Informatics, Vanderbilt University Medical Center, Nashville, Tennessee, USA.
Dean F SittigSchool of Biomedical Informatics, University of Texas Health Science Center at Houston, Houston, Texas, USA.ORCID 0000-0001-5811-8915

Funding

Improving Quality by Maintaining Accurate Problem Lists in the EHR (IQ-MAPLE)R01HL122225 · NHLBI · BRIGHAM AND WOMEN'S HOSPITAL · PI WRIGHT, ADAM T · 2014 to 2017
$2.2M
NHLBI NIH HHS R01 HL122225
6 · The paper itself

Abstract

objectiveTo improve problem list documentation and care quality. MATERIALS AND

methodsWe developed algorithms to infer clinical problems a patient has that are not recorded on the coded problem list using structured data in the electronic health record (EHR) for 12 clinically significant heart, lung, and blood diseases. We also developed a clinical decision support (CDS) intervention which suggests adding missing problems to the problem list. We evaluated the intervention at 4 diverse healthcare systems using 3 different EHRs in a randomized trial using 3 predetermined outcome measures: alert acceptance, problem addition, and National Committee for Quality Assurance Healthcare Effectiveness Data and Information Set (NCQA HEDIS) clinical quality measures.

resultsThere were 288 832 opportunities to add a problem in the intervention arm and the problem was added 63 777 times (acceptance rate 22.1%). The intervention arm had 4.6 times as many problems added as the control arm. There were no significant differences in any of the clinical quality measures. DISCUSSION: The CDS intervention was highly effective at improving problem list completeness. However, the improvement in problem list utilization was not associated with improvement in the quality measures. The lack of effect on quality measures suggests that problem list documentation is not directly associated with improvements in quality measured by National Committee for Quality Assurance Healthcare Effectiveness Data and Information Set (NCQA HEDIS) quality measures. However, improved problem list accuracy has other benefits, including clinical care, patient comprehension of health conditions, accurate CDS and population health, and for research.

conclusionAn EHR-embedded CDS intervention was effective at improving problem list completeness but was not associated with improvement in quality measures.

Indexed as

Decision Support Systems, ClinicalElectronic Health RecordsHumansQuality of Health Careclinical decision supportelectronic health recordproblem list

Identifiers

PMID36806929
PMCPMC10114117

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.