Evidence map›Paper›PMID 32167479›Full record

ArticleJournal of medical Internet research2020

A Late Attempt to Involve End Users in the Design of Medication-Related Alerts: Survey Study.

Melissa Therese Baysari, Wu Yi Zheng, Bethany Van Dort, Hannah Reid-Anderson, Mihaela Gronski, Eliza Kenny

Open access · goldAbstract read
In one paragraph

Article in Journal of medical Internet research, 2020. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 12 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
12citing papers in PubMed, 1 pooled it
3.5field-weighted citation impact, top 7% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

12 citing papers in PubMed, 1 synthesis or guideline pooled it, 25 citations in OpenAlex.

  1. Pooled it
  2. Article
  3. Article
  4. Article
  5. Article
  6. Article
  7. Article
  8. Article
  9. Article
  10. Observational
  11. Article
  12. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

6 authors at 2 institutions in 1 country.

Melissa Therese BaysariFaculty of Health Sciences, The University of Sydney, Sydney, Australia.ORCID 0000-0003-1645-9126
Wu Yi ZhengFaculty of Health Sciences, The University of Sydney, Sydney, Australia.ORCID 0000-0002-1159-4700
Bethany Van DortFaculty of Health Sciences, The University of Sydney, Sydney, Australia.ORCID 0000-0003-0052-6400
Hannah Reid-AndersonMacquarie University Hospital, Sydney, Australia.ORCID 0000-0001-5287-4154
Mihaela GronskiMacquarie University Hospital, Sydney, Australia.ORCID 0000-0002-4092-465X
Eliza KennyMacquarie University Hospital, Sydney, Australia.ORCID 0000-0002-7823-7740
Macquarie University · AUThe University of Sydney · AU

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

backgroundWhen users of electronic medical records (EMRs) are presented with large numbers of irrelevant computerized alerts, they experience alert fatigue, begin to ignore alert information, and override alerts without processing or heeding alert recommendations. Anecdotally, doctors at our study site were dissatisfied with the medication-related alerts being generated, both in terms of volume being experienced and clinical relevance.

objectiveThis study aimed to involve end users in the redesign of medication-related alerts in a hospital EMR, 4 years post implementation.

methodsThis work was undertaken at a private not-for-profit teaching hospital in Sydney, Australia. Since EMR implementation in 2015, the organization elected to implement all medication-related alert types available in the system for prescribers: allergy and intolerance alerts, therapeutic duplication alerts, pregnancy alerts, and drug-drug interaction alerts. The EMR included no medication administration alerts for nurses. To obtain feedback on current alerts and suggestions for redesign, a Web-based survey was distributed to all doctors and nurses at the site via hospital mailing lists.

resultsDespite a general dissatisfaction with alerts, very few end users completed the survey. In total, only 3.37% (36/1066) of doctors and 14.5% (60/411) of nurses took part. Approximately 90% (30/33) of doctors who responded held the view that too many alerts were triggered in the EMR. Doctors suggested that most alerts be removed and that alerts be more specific and less sensitive. In contrast, 97% (58/60) of the nurse respondents indicated that they would like to receive medication administration alerts in the EMR. Most nurses indicated that they would like to receive all the alert types available at all severity levels.

conclusionsAttempting to engage with end users several years post implementation was challenging. Involving users so late in the implementation process may lead to clinicians viewing the provision of feedback to be futile. Seeking user feedback on usefulness, volume, and design of alerts is extremely valuable; however, we suggest this is undertaken early, preferably before system implementation.

Indexed as

Decision Support Systems, ClinicalElectronic Health RecordsHumansMedical Order Entry SystemsSurveys and Questionnairesalert fatiguealertingclinical decision supporthospital information systemsmedication alert systems

Identifiers

PMID32167479
PMCPMC7101499
OpenAlexW3011210112

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.