Evidence map›Paper›PMID 33250363›Full record

Observational studyResearch in social & administrative pharmacy : RSAP2021

A user-centered evaluation of medication therapy management alerts for community pharmacists: Recommendations to improve usability and usefulness.

Margie E Snyder, Omolola A Adeoye-Olatunde, Stephanie A Gernant, Julie DiIulio, Heather A Jaynes, William R Doucette, Alissa L Russ-Jara

Abstract readObservational Study
In one paragraph

Observational study in Research in social & administrative pharmacy : RSAP, 2021. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 5 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
5citing papers in PubMed, 1 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

5 citing papers in PubMed, 1 synthesis or guideline pooled it.

  1. Pooled it
  2. Article
  3. Article
  4. Human factors and ergonomics methods for pharmacy research and clinical practice.Research in social & administrative pharmacy : RSAP · 2021
    Review
  5. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

7 authors.

Margie E SnyderPurdue University College of Pharmacy, Fifth Third Bank Building, 640 Eskenazi Avenue, Indianapolis, IN, 46202, USA. Electronic address: snyderme@purdue.edu.
Omolola A Adeoye-OlatundePurdue University College of Pharmacy, Fifth Third Bank Building, 640 Eskenazi Avenue, Indianapolis, IN, 46202, USA. Electronic address: adeoyeo@purdue.edu.
Stephanie A GernantUniversity of Connecticut School of Pharmacy, 69 North Eagleville Rd, U-3095, Storrs, CT, 06269, USA. Electronic address: Stephanie.gernant@uconn.edu.
Julie DiIulioApplied Decision Science, 1776 Mentor Ave. #424, Cincinnati, OH, 45212, USA. Electronic address: j.diiulio@applieddecisionscience.com.
Heather A JaynesPurdue University College of Pharmacy, Fifth Third Bank Building, 640 Eskenazi Avenue, Indianapolis, IN, 46202, USA. Electronic address: hrwoblew@iu.edu.
William R DoucetteUniversity of Iowa College of Pharmacy, 339 CPB 180 S. Grand Avenue, Iowa City, IA, 52242, USA. Electronic address: William-doucette@uiowa.edu.
Alissa L Russ-JaraPurdue University College of Pharmacy, Fifth Third Bank Building, 640 Eskenazi Avenue, Indianapolis, IN, 46202, USA. Electronic address: aruss@purdue.edu.

Funding

Indiana Clinical and Translational Sciences InstituteTL1TR001107 · NCATS · INDIANA UNIVERSITY INDIANAPOLIS · PI DENNE, SCOTT C., SHEKHAR, ANANTHA · 2013 to 2017
$2.0M
Enhancing Clinical Decision Support Applications for Community Pharmacist-Delivered Medication Therapy ManagementR21HS025005 · AHRQ · PURDUE UNIVERSITY · PI SNYDER, MARGIE E · 2016 to 2017
$296k
AHRQ HHS R21 HS025005NCATS NIH HHS TL1 TR001107
6 · The paper itself

Abstract

backgroundCommunity pharmacists provide comprehensive medication reviews (CMRs) through pharmacy contracts with medication therapy management (MTM) vendors. These CMRs are documented in the vendors' web-based MTM software platforms, which often integrate alerts to assist pharmacists in the detection of medication therapy problems. Understanding pharmacists' experiences with MTM alerts is critical to optimizing alert design for patient care.

objectivesThe objectives of this study were to 1) assess the usability and usefulness of MTM alerts for MTM vendor-contracted community pharmacists and 2) generate recommendations for improving MTM alerts for use by community pharmacists.

methodsThis was a convergent, parallel mixed-methods evaluation of data collected from 3 sources, with individual pharmacists contributing data to one or more sources: 1) community pharmacists' submissions of observational data about MTM alerts encountered during routine MTM provision, 2) videos of naturalistic usability testing of MTM alerts, and 3) semi-structured interviews to elicit pharmacists' perspectives on MTM alert usefulness and usability. MTM alert data submitted by pharmacists were summarized with descriptive statistics. Usability testing videos were analyzed to determine pharmacists' time spent on MTM alerts and to identify negative usability incidents. Interview transcripts were analyzed using a hybrid approach of deductive and inductive codes to identify emergent themes. Triangulation of data (i.e., determination of convergence/divergence in findings across all data sources) occurred through investigator discussion and identified overarching findings pertaining to key MTM alert challenges. These resulted in actionable recommendations to improve MTM alerts for use by community pharmacists.

resultsCollectively, two and four overarching key challenges pertaining to MTM alert usability and usefulness, respectively, were identified, resulting in 15 actionable recommendations for improving the design of MTM alerts from a user-centered perspective.

conclusionsRecommendations are expected to inform enhanced MTM alert designs that can improve pharmacist efficiency, patient and prescriber satisfaction with MTM, and patient outcomes.

Indexed as

Community Pharmacy ServicesPharmaciesHumansMedication Therapy ManagementPharmacistsClinicalCommunity pharmacy servicesDecision support systemsMedicareMedication therapy management

Identifiers

PMID33250363
PMCPMC9178508

What OpenQuestion holds

Textmetadata
LicenceTDM
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.