Evidence map›Paper›PMID 37067255›Full record

ReviewEuropean journal of clinical investigation2023

Flaws and uncertainties in pandemic global excess death calculations.

John P A Ioannidis, Francesco Zonta, Michael Levitt

Abstract readReview
In one paragraph

Review in European journal of clinical investigation, 2023. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 25 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
25citing papers in PubMed, 1 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

25 citing papers in PubMed, 1 synthesis or guideline pooled it.

  1. Pooled it
  2. Article
  3. Paid and unpaid productivity losses across 28 European countries due to excess deaths and COVID-19 deaths from 2020 to 2023.The European journal of health economics : HEPAC : health economics in prevention and care · 2026
    Article
  4. Article
  5. Article
  6. Article
  7. Article
  8. Article
  9. Article
  10. Article
  11. Article
  12. Article
  13. Article
  14. Article
  15. Article
  16. Article
  17. Article
  18. Article
  19. Excess Deaths in Korea During the COVID-19 Pandemic: 2020-2022.Journal of preventive medicine and public health = Yebang Uihakhoe chi · 2024
    Article
  20. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

3 authors.

John P A IoannidisDepartments of Medicine, of Epidemiology and Population Health, of Biomedical Data Science, and of Statistics, and Meta-Research Innovation Center at Stanford (METRICS), Stanford University, Stanford, California, USA.ORCID https://orcid.org/0000-0003-3118-6859
Francesco ZontaShanghai Institute for Advanced Immunochemical Studies, ShanghaiTech University, Shanghai, China.
Michael LevittDepartment of Structural Biology, Stanford University, Stanford, California, USA.

Funding

Emergent Properties of Complex Systems: From Atoms to Macromolecules; from Humans to SocietiesR35GM122543 · NIGMS · STANFORD UNIVERSITY · PI MICHAEL LEVITT · 2017 to 2026
$5.1M
NIGMS NIH HHS R35 GM122543
6 · The paper itself

Abstract

Several teams have been publishing global estimates of excess deaths during the COVID-19 pandemic. Here, we examine potential flaws and underappreciated sources of uncertainty in global excess death calculations. Adjusting for changing population age structure is essential. Otherwise, excess deaths are markedly overestimated in countries with increasingly aging populations. Adjusting for changes in other high-risk indicators, such as residence in long-term facilities, may also make a difference. Death registration is highly incomplete in most countries; completeness corrections should allow for substantial uncertainty and consider that completeness may have changed during pandemic years. Excess death estimates have high sensitivity to modelling choice. Therefore different options should be considered and the full range of results should be shown for different choices of pre-pandemic reference periods and imposed models. Any post-modelling corrections in specific countries should be guided by pre-specified rules. Modelling of all-cause mortality (ACM) in countries that have ACM data and extrapolating these models to other countries is precarious; models may lack transportability. Existing global excess death estimates underestimate the overall uncertainty that is multiplicative across diverse sources of uncertainty. Informative excess death estimates require risk stratification, including age groups and ethnic/racial strata. Data to-date suggest a death deficit among children during the pandemic and marked socioeconomic differences in deaths, widening inequalities. Finally, causal explanations require great caution in disentangling SARS-CoV-2 deaths, indirect pandemic effects and effects from measures taken. We conclude that excess deaths have many uncertainties, but globally deaths from SARS-CoV-2 may be the minority of calculated excess deaths.

Indexed as

COVID-19PandemicsCause of DeathChildHumansSARS-CoV-2UncertaintybiasCOVID-19death certificatesdemographyexcess deathsmortality

Identifiers

PMID37067255
PMCPMC10404446

What OpenQuestion holds

Textmetadata
LicenceTDM
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.