Evidence map›Paper›PMID 34930309›Full record

ArticleHealth research policy and systems2021

Engaging citizens in the development of a health system performance assessment framework: a case study in Ireland.

Óscar Brito Fernandes, Erica Barbazza, Damir Ivanković, Tessa Jansen, Niek S Klazinga, Dionne S Kringos

Open access · goldAbstract read
In one paragraph

Article in Health research policy and systems, 2021. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 4 papers.

0numbers the graph read from it
0cells of the map it votes in
4citing papers in PubMed
2.3field-weighted citation impact, top 11% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

4 citing papers in PubMed, 11 citations in OpenAlex.

  1. Article
  2. Article
  3. Engaging citizens to improve service provision for oral health.Bulletin of the World Health Organization · 2022
    Article
  4. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

6 authors at 2 institutions in 2 countries.

Óscar Brito FernandesDepartment of Health Economics, Corvinus University of Budapest, Fővám tér 8, 1093, Budapest, Hungary. o.r.britofernandes@amsterdamumc.nl.ORCID http://orcid.org/0000-0002-3212-373X
Erica BarbazzaDepartment of Public and Occupational Health, Amsterdam UMC, Amsterdam Public Health research institute, University of Amsterdam, Meibergdreef 9, 1105 AZ, Amsterdam, The Netherlands.ORCID http://orcid.org/0000-0001-7621-1638
Damir IvankovićDepartment of Public and Occupational Health, Amsterdam UMC, Amsterdam Public Health research institute, University of Amsterdam, Meibergdreef 9, 1105 AZ, Amsterdam, The Netherlands.ORCID http://orcid.org/0000-0002-3501-5515
Tessa JansenDepartment of Public and Occupational Health, Amsterdam UMC, Amsterdam Public Health research institute, University of Amsterdam, Meibergdreef 9, 1105 AZ, Amsterdam, The Netherlands.ORCID http://orcid.org/0000-0002-2948-0533
Niek S KlazingaDepartment of Public and Occupational Health, Amsterdam UMC, Amsterdam Public Health research institute, University of Amsterdam, Meibergdreef 9, 1105 AZ, Amsterdam, The Netherlands.ORCID http://orcid.org/0000-0002-3937-8014
Dionne S KringosDepartment of Public and Occupational Health, Amsterdam UMC, Amsterdam Public Health research institute, University of Amsterdam, Meibergdreef 9, 1105 AZ, Amsterdam, The Netherlands.ORCID http://orcid.org/0000-0003-2711-4713
Amsterdam University Medical Centers · NLCorvinus University of Budapest · HU

Funding

European Commission SRSS/C2019/046H2020 Marie Skłodowska-Curie Actions 765141
6 · The paper itself

Abstract

backgroundThe launch in 2017 of the Irish 10-year reform programme Sláintecare represents a key commitment in the future of the health system. An important component of the programme was the development of a health system performance assessment (HSPA) framework. In 2019, the Department of Health of Ireland (DoH) and Health Service Executive (HSE) commissioned the technical support of researchers to develop an outcome-oriented HSPA framework which should reflect the shared priorities of multiple stakeholders, including citizens. This study describes the method applied in the Irish context and reflects on the added value of using a citizen panel in the development of an HSPA framework.

methodsA panel of 15 citizens was convened, recruited by a third-party company using a sampling strategy to achieve a balanced mix representing the Irish society. Panellists received lay-language preparatory materials before the meeting. Panellists used a three-colour scheme to signal the importance of performance measures. An exit questionnaire was administered to understand how participants experienced being part of the panel. The citizen panel was the first in a series of three panels towards the development of the HSPA framework, followed by panels including representatives of the DoH and HSE, and representatives from professional associations and special interest groups.

resultsThe citizen panel generated 249 health performance measures ranging across 13 domains. Top-ranking domains to the citizen panel (people-centredness, coordination of care, and coverage) were less prioritized by the other panels; domains less prioritized by the citizen panel, such as accessibility, responsiveness, efficiency, and effectiveness, were of higher priority in the other panels. Citizen panellists shared a similar understanding of what a citizen panel involves and described their experience at the panel as enjoyable, interesting, and informative.

conclusionsThe priorities of the citizen panel were accounted for during all phases of developing the HSPA framework. This was possible by adopting an inclusive development process and by engaging citizens early on. Citizen engagement in HSPA development is essential for realizing citizen-driven healthcare system performance and generating trust and ownership in performance intelligence. Future research could expand the use of citizen panels to assess, monitor, and report on the performance of healthcare systems.

Indexed as

Government ProgramsHumansIrelandFocus groupHealthcare system performanceIrelandPerformance intelligencePriority-settingPublic deliberationSláintecareStakeholder panel

Identifiers

PMID34930309
PMCPMC8685819
OpenAlexW4200163898

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.