Evidence map›Paper›PMID 37043153›Full record

ArticleEuropean journal of epidemiology2023

Excess death estimates from multiverse analysis in 2009-2021.

Michael Levitt, Francesco Zonta, John P A Ioannidis

Abstract read
In one paragraph

Article in European journal of epidemiology, 2023. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 23 papers, 2 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
23citing papers in PubMed, 2 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

23 citing papers in PubMed, 2 syntheses or guidelines pooled it.

  1. Pooled it
  2. Pooled it
  3. Paid and unpaid productivity losses across 28 European countries due to excess deaths and COVID-19 deaths from 2020 to 2023.The European journal of health economics : HEPAC : health economics in prevention and care · 2026
    Article
  4. Article
  5. Article
  6. Article
  7. Article
  8. Article
  9. Article
  10. Article
  11. Article
  12. Article
  13. Review
  14. Article
  15. Article
  16. Review
  17. Variability in excess deaths across countries with different vulnerability during 2020-2023.Proceedings of the National Academy of Sciences of the United States of America · 2023
    Article
  18. Article
  19. Article
  20. Article
4 · The record

Corrections and comments

5 · Who and what money

Authors and funding

3 authors.

Michael LevittDepartment of Structural Biology, Stanford University, Stanford, CA, 94305, USA.
Francesco ZontaShanghai Institute for Advanced Immunochemical Studies, ShanghaiTech University, Shanghai, 201210, China.
John P A IoannidisDepartments of Medicine, of Epidemiology and Population Health, of Biomedical Data Science, and of Statistics, and Meta-Research Innovation Center at Stanford (METRICS), Stanford University, Stanford, CA, 94305, USA. jioannid@stanford.edu.ORCID http://orcid.org/0000-0003-3118-6859

Funding

Emergent Properties of Complex Systems: From Atoms to Macromolecules; from Humans to SocietiesR35GM122543 · NIGMS · STANFORD UNIVERSITY · PI MICHAEL LEVITT · 2017 to 2026
$5.1M
NIGMS NIH HHS NIH R35 GM122543NIGMS NIH HHS R35 GM122543
6 · The paper itself

Abstract

Excess death estimates have great value in public health, but they can be sensitive to analytical choices. Here we propose a multiverse analysis approach that considers all possible different time periods for defining the reference baseline and a range of 1 to 4 years for the projected time period for which excess deaths are calculated. We used data from the Human Mortality Database on 33 countries with detailed age-stratified death information on an annual basis during the period 2009-2021. The use of different time periods for reference baseline led to large variability in the absolute magnitude of the exact excess death estimates. However, the relative ranking of different countries compared to others for specific years remained largely unaltered. The relative ranking of different years for the specific country was also largely independent of baseline. Averaging across all possible analyses, distinct time patterns were discerned across different countries. Countries had declines between 2009 and 2019, but the steepness of the decline varied markedly. There were also large differences across countries on whether the COVID-19 pandemic years 2020-2021 resulted in an increase of excess deaths and by how much. Consideration of longer projected time windows resulted in substantial shrinking of the excess deaths in many, but not all countries. Multiverse analysis of excess deaths over long periods of interest can offer an approach that better accounts for the uncertainty in estimating expected mortality patterns, comparative mortality trends across different countries, and the nature of observed mortality peaks.

Indexed as

COVID-19PandemicsForecastingGlobal HealthHumansPublic HealthCOVID-19EpidemiologyExcess mortalityModelingMortality

Identifiers

PMID37043153
PMCPMC10090741

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.