ArticleBMC public health2018
Indicators for evaluating European population health: a Delphi selection process.
Article in BMC public health, 2018. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 30 papers, 2 of them syntheses that pooled it.
What it found
Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.
The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.
The trial behind it
Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.
Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.
Who cites it
30 citing papers in PubMed, 2 syntheses or guidelines pooled it.
- Clinical pharmacy key performance indicators for hospital inpatient setting: a systematic review.International journal of clinical pharmacy · 2024Pooled it
- Selecting Indicators to Monitor and Assess Environmental Health in a Portuguese Urban Setting: A Participatory Approach.International journal of environmental research and public health · 2020Pooled it
- Key performance indicators for hospital clinical pharmacy services: results of a global Delphi study.International journal of clinical pharmacy · 2026Article
- From predefined indicators to a management dashboard for heart failure telemonitoring: a modified nominal group technique approach in Portuguese hospitals.BMC health services research · 2026Article
- Article
- Identification and prioritization of population health indices in Iranian population, a qualitative study.BMC public health · 2025Article
- Priority indicators for evaluating the impact of field epidemiology training programs - results of a global modified Delphi study.BMC public health · 2025Article
- Defining the multifaceted roles of dental academics: A consensus approach using the Fuzzy Delphi Method.PloS one · 2025Article
- Towards a sustainable set of European Core Health Indicators (ECHI).Journal of health monitoring · 2024Article
- How can health technology assessment be improved to optimise access to medicines? Results from a Delphi study in Europe : Better access to medicines through HTA.The European journal of health economics : HEPAC : health economics in prevention and care · 2024Article
- Quality of Life of Colorectal Cancer Survivors: Mapping the Key Indicators by Expert Consensus and Measures for Their Assessment.Healthcare (Basel, Switzerland) · 2024Article
- Developing consensus to enhance perinatal mental health through a model of integrated care: Delphi study.PloS one · 2024Article
- Analysis of the Impact of Public Services on Residents' Health: A Spatial Econometric Analysis of Chinese Provinces.International journal of public health · 2023Article
- Informing the Design of Data Visualization Tools to Monitor the COVID-19 Pandemic in Portugal: A Web-Delphi Participatory Approach.International journal of environmental research and public health · 2022Article
- Developing a National Set of Health Equity Indicators Using a Consensus Building Process.International journal of health policy and management · 2022Article
- Establishing an Expert Consensus on Key Indicators of the Quality of Life among Breast Cancer Survivors: A Modified Delphi Study.Journal of clinical medicine · 2022Article
- Developing Key Performance Indicators for Emergency Department of Teaching Hospitals: A Mixed Fuzzy Delphi and Nominal Group Technique Approach.The Malaysian journal of medical sciences : MJMS · 2022Article
- Inconvenience and adaptation in Japanese adult achondroplasia and hypochondroplasia: A cross-sectional study.Clinical pediatric endocrinology : case reports and clinical investigations : official journal of the Japanese Society for Pediatric Endocrinology · 2022Article
- Trends of amenable deaths due to healthcare within the European Union countries. Exploring the association with the economic crisis and education.SSM - population health · 2021Article
- Inequalities in Health: Methodological Approaches to Spatial Differentiation.International journal of environmental research and public health · 2021Article
Corrections and comments
PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.
Authors and funding
6 authors.
Funding
Abstract
backgroundIndicators are essential instruments for monitoring and evaluating population health. The selection of a multidimensional set of indicators should not only reflect the scientific evidence on health outcomes and health determinants, but also the views of health experts and stakeholders. The aim of this study is to describe the Delphi selection process designed to promote agreement on indicators considered relevant to evaluate population health at the European regional level.
methodsIndicators were selected in a Delphi survey conducted using a web-platform designed to implement and monitor participatory processes. It involved a panel of 51 experts and 30 stakeholders from different areas of knowledge and geographies. In three consecutive rounds the panel indicated their level of agreement or disagreement with indicator's relevance for evaluating population health in Europe. Inferential statistics were applied to draw conclusions on observed level of agreement (Scott's Pi interrater reliability coefficient) and opinion change (McNemar Chi-square test). Multivariate analysis of variance was conducted to check if the field of expertise influenced the panellist responses (Wilk's Lambda test).
resultsThe panel participated extensively in the study (overall response rate: 80%). Eighty indicators reached group agreement for selection in the areas of: economic and social environment (12); demographic change (5); lifestyle and health behaviours (8); physical environment (6); built environment (12); healthcare services (11) and health outcomes (26). Higher convergence of group opinion towards agreement on the relevance of indicators was seen for lifestyle and health behaviours, healthcare services, and health outcomes. The panellists' field of expertise influenced responses: statistically significant differences were found for economic and social environment (p < 0.05 in round 1 and 2), physical environment (p < 0.01 in round 1) and health outcomes (p < 0.01 in round 3).
conclusionsThe high levels of participation observed in this study, by involving experts and stakeholders and ascertaining their views, underpinned the added value of using a transparent Web-Delphi process to promote agreement on what indicators are relevant to appraise population health.
Indexed as
Identifiers
What OpenQuestion holds
Registered trials
Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.