Evidence map›Paper›PMID 36257867›Full record

SynthesisHealth policy (Amsterdam, Netherlands)2022

Metrics and indicators used to assess health system resilience in response to shocks to health systems in high income countries-A systematic review.

Pádraic Fleming, Catherine O'Donoghue, Arianna Almirall-Sanchez, David Mockler, Conor Keegan, Jon Cylus, Anna Sagan, Steve Thomas

Abstract readSystematic Review
In one paragraph

Synthesis in Health policy (Amsterdam, Netherlands), 2022. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 33 papers, 3 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
33citing papers in PubMed, 3 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

33 citing papers in PubMed, 3 syntheses or guidelines pooled it.

  1. Measuring hospital care resilience: a systematic literature review.The European journal of health economics : HEPAC : health economics in prevention and care · 2026
    Pooled it
  2. Pooled it
  3. Pooled it
  4. Article
  5. Article
  6. Article
  7. Review
  8. Article
  9. Review
  10. Article
  11. Article
  12. Article
  13. Article
  14. Article
  15. Pandemic Performance Measures of Resilience for Healthcare and Education in the Netherlands.The International journal of health planning and management · 2025
    Article
  16. Article
  17. [Healthcare institution resilience and the influencing factors during infectious disease outbreaks].Beijing da xue xue bao. Yi xue ban = Journal of Peking University. Health sciences · 2025
    Article
  18. Article
  19. Article
  20. Review
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

8 authors.

Pádraic FlemingCentre for Health Policy and Management, School of Medicine, Trinity College Dublin, 3-4 Foster Place, Dublin, Ireland. Electronic address: Padraic.fleming@tcd.ie.
Catherine O'DonoghueCentre for Health Policy and Management, School of Medicine, Trinity College Dublin, 3-4 Foster Place, Dublin, Ireland.
Arianna Almirall-SanchezCentre for Health Policy and Management, School of Medicine, Trinity College Dublin, 3-4 Foster Place, Dublin, Ireland.
David MocklerJohn Stearne Library, Trinity Centre for Health Sciences, St. James' Hospital, Dublin, Ireland.
Conor KeeganThe Economic and Social Research Institute, Whitaker Square, Sir John Rogerson's Quay, Dublin D02 K138, Ireland.
Jon CylusEuropean Observatory on Health Systems and Policies, London School of Economics and Political Science, Houghton Street, London WC2A 2AE, United Kingdom.
Anna SaganEuropean Observatory on Health Systems and Policies, London School of Economics and Political Science, Houghton Street, London WC2A 2AE, United Kingdom; European Observatory on Health Systems and Policies, London School of Hygiene and Tropical Medicine, Keppel Street, London WC1E 7HT, United Kingdom.
Steve ThomasCentre for Health Policy and Management, School of Medicine, Trinity College Dublin, 3-4 Foster Place, Dublin, Ireland.

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

Health system resilience has never been more important than with the COVID-19 pandemic. There is need to identify feasible measures of resilience, potential strategies to build resilience and weaknesses of health systems experiencing shocks. The purpose of this systematic review is to examine how the resilience of health systems has been measured across various health system shocks. Following PRISMA guidelines, with double screening at each stage, the review identified 3175 studies of which 68 studies were finally included for analysis. Almost half (46%) were focused on COVID-19, followed by the economic crises, disasters and previous pandemics. Over 80% of studies included quantitative metrics. The most common WHO health system functions studied were resources and service delivery. In relation to the shock cycle, most studies reported metrics related to the management stage (79%) with the fewest addressing recovery and learning (22%). Common metrics related to staff headcount, staff wellbeing, bed number and type, impact on utilisation and quality, public and private health spending, access and coverage, and information systems. Limited progress has been made with developing standardised qualitative metrics particularly around governance. Quantitative metrics need to be analysed in relation to change and the impact of the shock. The review notes problems with measuring preparedness and the fact that few studies have really assessed the legacy or enduring impact of shocks.

Indexed as

COVID-19PandemicsBenchmarkingDeveloped CountriesGovernment ProgramsHumans

Identifiers

PMID36257867
PMCPMC9556803

What OpenQuestion holds

Textmetadata
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.