Evidence map›Paper›PMID 32071560›Full record

ReviewCost effectiveness and resource allocation : C/E2020

Development of the WHO-INTEGRATE evidence-to-decision framework: an overview of systematic reviews of decision criteria for health decision-making.

J M Stratil, R Baltussen, I Scheel, A Nacken, E A Rehfuess

Abstract readReview
In one paragraph

Review in Cost effectiveness and resource allocation : C/E, 2020. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 28 papers, 3 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
28citing papers in PubMed, 3 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

28 citing papers in PubMed, 3 syntheses or guidelines pooled it.

  1. Pooled it
  2. Pooled it
  3. Pooled it
  4. Article
  5. Review
  6. Key attributes of health and environmental risk decision-making: A scoping review.Risk analysis : an official publication of the Society for Risk Analysis · 2025
    Article
  7. Frameworks to support evidence-informed decision-making in public health and infectious disease prevention and control: a scoping review.Euro surveillance : bulletin Europeen sur les maladies transmissibles = European communicable disease bulletin · 2025
    Article
  8. Review
  9. Article
  10. Article
  11. Article
  12. Article
  13. Article
  14. Article
  15. Article
  16. Article
  17. Article
  18. Article
  19. Review
  20. Review
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

5 authors.

J M Stratil1Institute for Medical Information Processing, Biometry and Epidemiology, Pettenkofer School of Public Health, LMU Munich, Marchioninistr. 15, 81377 Munich, Germany.
R Baltussen2Department for Health Evidence, Radboud University Medical Center, P.O.Box 9101, 6500 HB Nijmegen, The Netherlands.
I Scheel3Department of Global Health, Norwegian Institute of Public Health, PO Box 4404, Nydalen, 0403 Oslo, Norway.
A Nacken1Institute for Medical Information Processing, Biometry and Epidemiology, Pettenkofer School of Public Health, LMU Munich, Marchioninistr. 15, 81377 Munich, Germany.
E A Rehfuess1Institute for Medical Information Processing, Biometry and Epidemiology, Pettenkofer School of Public Health, LMU Munich, Marchioninistr. 15, 81377 Munich, Germany.

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

backgroundDecision-making in public health and health policy is complex and requires careful deliberation of many and sometimes conflicting normative and technical criteria. Several approaches and tools, such as multi-criteria decision analysis, health technology assessments and evidence-to-decision (EtD) frameworks, have been proposed to guide decision-makers in selecting the criteria most relevant and appropriate for a transparent decision-making process. This study forms part of the development of the WHO-INTEGRATE EtD framework, a framework rooted in global health norms and values as reflected in key documents of the World Health Organization and the United Nations system. The objective of this study was to provide a comprehensive overview of criteria used in or proposed for real-world decision-making processes, including guideline development, health technology assessment, resource allocation and others.

methodsWe conducted an overview of systematic reviews through a combination of systematic literature searches and extensive reference searches. Systematic reviews reporting criteria used for real-world health decision-making by governmental or non-governmental organization on a supranational, national, or programme level were included and their quality assessed through a bespoke critical appraisal tool. The criteria reported in the reviews were extracted, de-duplicated and sorted into first-level (i.e.

resultsWe included 36 systematic reviews providing criteria, of which one met all and another eleven met at least five of the items of our critical appraisal tool. The criteria were subsumed into 8

conclusionThis overview of systematic reviews provides a comprehensive overview of criteria used or suggested for real-world health decision-making. It also discusses key challenges in the selection of the most appropriate criteria and in seeking to implement a fair decision-making process.

Indexed as

CriteriaDecision-makingDecisionmakingHealth technology assessmentHTAPriority-settingResource allocationWHOWHO-INTEGRATE

Identifiers

PMID32071560
PMCPMC7014604

What OpenQuestion holds

Textmetadata
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.