Evidence map›Paper›PMID 35906667›Full record

ArticleArchives of public health = Archives belges de sante publique2022

"We cobble together a storyline of system performance using a diversity of things": a qualitative study of perspectives on public health performance measurement in Canada.

Meghan O'Neill, Eric De Prophetis, Sara Allin, Andrew D Pinto, Robert W Smith, Erica Di Ruggiero, Robert Schwartz, Jasmine Pawa, Mehdi Ammi, Laura C Rosella

Abstract read
In one paragraph

Article in Archives of public health = Archives belges de sante publique, 2022. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 2 papers.

0numbers the graph read from it
0cells of the map it votes in
2citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

2 citing papers in PubMed.

  1. Article
  2. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

10 authors.

Meghan O'NeillPopulation Health Analytics Lab, Dalla Lana School of Public Health, University of Toronto, Toronto, Ontario, Canada.
Eric De ProphetisPopulation Health Analytics Lab, Dalla Lana School of Public Health, University of Toronto, Toronto, Ontario, Canada.
Sara AllinInstitute for Health Policy, Management and Evaluation, Dalla Lana School of Public Health, University of Toronto, Toronto, Ontario, Canada.
Andrew D PintoInstitute for Health Policy, Management and Evaluation, Dalla Lana School of Public Health, University of Toronto, Toronto, Ontario, Canada.
Robert W SmithInstitute for Health Policy, Management and Evaluation, Dalla Lana School of Public Health, University of Toronto, Toronto, Ontario, Canada.
Erica Di RuggieroInstitute for Health Policy, Management and Evaluation, Dalla Lana School of Public Health, University of Toronto, Toronto, Ontario, Canada.
Robert SchwartzInstitute for Health Policy, Management and Evaluation, Dalla Lana School of Public Health, University of Toronto, Toronto, Ontario, Canada.
Jasmine PawaDivision of Clinical Public Health, Dalla Lana School of Public Health, University of Toronto, Toronto, Ontario, Canada.
Mehdi AmmiSchool of Public Policy and Administration, Carleton University, Ottawa, Ontario, Canada.
Laura C RosellaPopulation Health Analytics Lab, Dalla Lana School of Public Health, University of Toronto, Toronto, Ontario, Canada. laura.rosella@utoronto.ca.

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

backgroundThere have been longstanding calls for public health systems transformations in many countries, including Canada. Core to these calls has been strengthening performance measurement. While advancements have been made in performance measurement for certain sectors of the health care system (primarily focused on acute and primary health care), effective use of indicators for measuring public health systems performance are lacking. This study describes the current state, anticipated challenges, and future directions in the development and implementation of a public health performance measurement system for Canada.

methodsWe conducted a qualitative study using semi-structured interviews with public health leaders (n = 9) between July and August 2021. Public health leaders included researchers, government staff, and former medical officers of health who were purposively selected due to their expertise and experience with performance measurement with relevance to public health systems in Canada. Thematic analysis included both a deductive approach for themes consistent with the conceptual framework and an inductive approach to allow new themes to emerge from the data.

resultsConceptual, methodological, contextual, and infrastructure challenges were highlighted by participants in designing a performance measurement system for public health. Specifically, six major themes evolved that encompass 1) the mission and purpose of public health systems, including challenges inherent in measuring the functions and services of public health; 2) the macro context, including the impacts of chronic underinvestment and one-time funding injections on the ability to sustain a measurement system; 3) the organizational structure/governance of public health systems including multiple forms across Canada and underdevelopment of information technology systems; 4) accountability approaches to performance measurement and management; and 5) timing and unobservability in public health indicators. These challenges require dedicated investment, strong leadership, and political will from the federal and provincial/territorial governments.

conclusionUnprecedented attention on public health due to the coronavirus disease 2019 pandemic has highlighted opportunities for system improvements, such as addressing the lack of a performance measurement system. This study provides actionable knowledge on conceptual, methodological, contextual, and infrastructure challenges needed to design and build a pan-Canadian performance measurement system for public health.

Indexed as

Health system renewal; performance measurement systemIndicatorsPublic healthPublic health systemsQualitative analysis

Identifiers

PMID35906667
PMCPMC9335461

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.