Evidence map›Paper›PMID 36529027›Full record

ArticleInternational journal of medical informatics2023

Dynamic reaction picklist for improving allergy reaction documentation: A usability study.

Liqin Wang, Heekyong Park, Sachin Vallamkonda, Diane L Seger, Suzanne V Blackley, Pamela M Garabedian, Foster Goss, Kimberly G Blumenthal, David W Bates, Shawn Murphy and 1 more

Open access · greenAbstract read
PubMed Full text at PMC Publisher
In one paragraph

Article in International journal of medical informatics, 2023. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Not yet cited in PubMed.

0numbers the graph read from it
0cells of the map it votes in
0citing papers in PubMed
0.3field-weighted citation impact, top 46% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

0 citing papers in PubMed, 2 citations in OpenAlex.

No citing paper in PubMed yet.

4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

11 authors at 3 institutions in 1 country.

Liqin WangDivision of General Internal Medicine and Primary Care, Brigham and Women's Hospital, Boston, MA, USA; Department of Medicine, Harvard Medical School, Boston, MA, USA. Electronic address: lwang@bwh.harvard.edu.
Heekyong ParkResearch Information Science and Computing, Mass General Brigham, Somerville, MA, USA.
Sachin VallamkondaDivision of General Internal Medicine and Primary Care, Brigham and Women's Hospital, Boston, MA, USA.
Diane L SegerClinical and Quality Analysis, Information Systems, Mass General Brigham, Somerville, MA, USA.
Suzanne V BlackleyClinical and Quality Analysis, Information Systems, Mass General Brigham, Somerville, MA, USA.
Pamela M GarabedianClinical and Quality Analysis, Information Systems, Mass General Brigham, Somerville, MA, USA.
Foster GossDepartment of Emergency Medicine, University of Colorado School of Medicine, Aurora, CO, USA.
Kimberly G BlumenthalDepartment of Medicine, Harvard Medical School, Boston, MA, USA; Division of Rheumatology, Allergy, and Immunology, Department of Medicine, Massachusetts General Hospital, Boston, MA, USA.
David W BatesDivision of General Internal Medicine and Primary Care, Brigham and Women's Hospital, Boston, MA, USA; Department of Medicine, Harvard Medical School, Boston, MA, USA.
Shawn MurphyDepartment of Medicine, Harvard Medical School, Boston, MA, USA; Research Information Science and Computing, Mass General Brigham, Somerville, MA, USA; Department of Neurology, Massachusetts General Hospital, Boston, MA, USA; Department of Biomedical Informatics, Harvard Medical School, Boston, MA, USA.
Li ZhouDivision of General Internal Medicine and Primary Care, Brigham and Women's Hospital, Boston, MA, USA; Department of Medicine, Harvard Medical School, Boston, MA, USA.
Brigham and Women's Hospital · USMass General Brigham · USUniversity of Colorado Denver · US

Funding

Clinical Informatics to Advance Epidemiology and Pharmacogenetics of Serious Cutaneous Adverse Drug ReactionsR01AI150295 · NIAID · BRIGHAM AND WOMEN'S HOSPITAL · PI ZHOU, LI · 2019 to 2022
$2.8M
Improving Allergy Documentation and Clinical Decision Support in the EHRR01HS025375 · AHRQ · BRIGHAM AND WOMEN'S HOSPITAL · PI ZHOU, LI · 2018 to 2021
$1.6M
AHRQ HHS R01 HS025375NIAID NIH HHS R01 AI150295
6 · The paper itself

Abstract

objectiveTo assess novel dynamic reaction picklists for improving allergy reaction documentation compared to a static reaction picklist. MATERIALS AND

methodsWe developed three web-based user interfaces (UIs) mimicking the Mass General Brigham's EHR allergy module: the first and second UIs (i.e., UI-1D, UI-2D) implemented two dynamic reaction picklists with different ranking algorithms and the third UI (UI-3S) implemented a static reaction picklist like the one used in the current EHR. We recruited 18 clinicians to perform allergy entry for 10 test cases each via UI-1D and UI-3S, and another 18 clinicians via UI-2D and UI-3S. Primary measures were the number of free-text entries and time to complete the allergy entry. Clinicians were also interviewed using 30 questions before and after the data entry. RESULTS AND DISCUSSIONS: Among 36 clinicians, less than half were satisfied with the current EHR reaction picklists, due to their incomprehensiveness, inefficiency, and lack of intuitiveness. The clinicians used significantly fewer free-text entries when using UI-1D or UI-2D compared to UI-3S (p < 0.05). The clinicians used on average 51 s (15 %) less time via UI-1D and 50 s (16 %) less time via UI-2D in completing the allergy entries versus UI-3S, and there was not a statistically significant difference in documentation time for either group between the dynamic and static UIs. Overall, 15-17 (83-94 %) clinicians rated UI-1D and 13-15 (72-83 %) clinicians rated UI-2D as efficient, easy to use, and useful, while less than half rated the same for UI-3S. Most clinicians reported that the dynamic reaction picklists always or often suggested appropriate reactions (n = 30, 83 %) and would decrease the free-text entries (n = 26, 72 %); nearly all preferred the dynamic picklist over the static picklist (n = 32, 89 %).

conclusionWe found that dynamic reaction picklists significantly reduced the number of free-text entries and could reduce the time for allergy documentation by 15%. Clinicians preferred the dynamic reaction picklist over the static picklist.

Indexed as

Electronic Health RecordsHypersensitivityDocumentationHumansDocumentationDrug hypersensitivityDrug-related side effects and adverse reactionsElectronic health recordUsabilityUser interface evaluation

Identifiers

PMID36529027
PMCPMC10167939
OpenAlexW4310673729

What OpenQuestion holds

Textmetadata
LicenceTDM
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.