Evidence map›Paper›PMID 30645647›Full record

ArticlePloS one2019

Developing key performance indicators for prescription medication systems.

Eldon Spackman, Fiona Clement, G Michael Allan, Chaim M Bell, Lise M Bjerre, Dave F Blackburn, Régis Blais, Glen Hazlewood, Scott Klarenbach, Lindsay E Nicolle and 5 more

Abstract read
In one paragraph

Article in PloS one, 2019. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 6 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
6citing papers in PubMed, 1 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

6 citing papers in PubMed, 1 synthesis or guideline pooled it.

  1. Pooled it
  2. Key Performance Indicators Applied in Medicine.International archives of otorhinolaryngology · 2025
    Article
  3. Article
  4. Key performance indicators for pharmaceutical services: A systematic review.Exploratory research in clinical and social pharmacy · 2024
    Review
  5. Article
  6. Review
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

15 authors.

Eldon SpackmanDepartment of Community Health Sciences and O'Brien Institute of Public Health, Calgary, Alberta, Canada.ORCID 0000-0001-8558-5973
Fiona ClementDepartment of Community Health Sciences and O'Brien Institute of Public Health, Calgary, Alberta, Canada.
G Michael AllanDepartment of Family Medicine, University of Alberta, Edmonton, Alberta, Canada.
Chaim M BellDepartment of Medicine, Sinai Health System and University of Toronto, Toronto, Ontario, Canada.
Lise M BjerreDepartment of Family Medicine, Bruyère Research Institute, and School of Epidemiology, Public Health and Preventive Medicine, University of Ottawa, Ottawa, Ontario, Canada.
Dave F BlackburnCollege of Pharmacy and Nutrition, University of Saskatchewan, Saskatoon, Saskatchewan, Canada.
Régis BlaisSchool of Public Health, Université de Montréal, Montreal, Quebec, Canada.
Glen HazlewoodDepartment of Community Health Sciences and O'Brien Institute of Public Health, Calgary, Alberta, Canada.
Scott KlarenbachDepartment of Medicine University of Alberta, Edmonton, Alberta, Canada.
Lindsay E NicolleRady Faculty of Health Sciences, University of Manitoba, Winnipeg, Manitoba, Canada.
Nav PersaudSt Michael's Hospital and University of Toronto, Toronto, Ontario, Canada.
Silvia Alessi-SeveriniCollege of Pharmacy and Manitoba Centre for Health Policy, Rady Faculty of Health Sciences, University of Manitoba, Winnipeg, Manitoba, Canada.
Mike TierneyIndependent Researcher, Ottawa, Onttario, Canada.
Harindra C WijeysunderaCanadian Agency for Drugs and Technology in Health (CADTH), Ottawa, Ontario, Canada.
Braden MannsDepartment of Community Health Sciences and O'Brien Institute of Public Health, Calgary, Alberta, Canada.

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

objectiveTo develop key performance indicators that evaluate the effectiveness of a prescription medication system.

methodsA modified RAND/UCLA appropriateness method was used to develop key performance indicators (KPIs) for a prescription medication system. A broad list of potential KPIs was compiled. A multidisciplinary group composed of 21 experts rated the potential KPIs. A face-to-face meeting was held following the first rating exercise to discuss each potential KPI individually. The expert panel undertook a final rating of KPIs. The final set of KPIs were those indicators where at least 80 percent of experts rated the indicator highly i.e. rating of ≥ 7 on a scale from 1 to 9.

results292 KPIs were identified from the published literature. After removing duplicates and combining similar indicators 71 KPIs were included. The final ranking resulted in six indicators being ranked 7 or higher by 80% of the respondents and an additional seven indicators being ranked 7 or higher by ≥70 but ≤80% of respondents. The six selected indicators include four specific disease areas, measure structural and process aspects of health service delivery, and assessed three of the domains of healthcare quality: efficiency, effectiveness, and safety.

conclusionsThese indicators are recommended as a starting point to assess the current performance of prescription medication systems. Consideration should be given to developing indicators in additional disease areas as well as indicators that measure the domains of timeliness and patient-centeredness. Future work should focus on the feasibility of measuring these indicators.

Indexed as

CanadaFemaleHumansMaleMedication SystemsPrescriptionsQuality Indicators, Health Care

Identifiers

PMID30645647
PMCPMC6333341

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.