Evidence map›Paper›PMID 42277702›Full record

ArticleBMC infectious diseases2026

Assessing human judgment forecasts in the rapid spread of the mpox outbreak: insights and challenges for pandemic preparedness.

Thomas Mcandrew, Maimuna S Majumder, Andrew A Lover, Srini Venkatramanan, Paolo Bocchini, Tamay Besiroglu, Allison Codi, Gaia Dempsey, Sam Abbott, Sylvain Chevalier and 3 more

Abstract read
In one paragraph

Article in BMC infectious diseases, 2026. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Not yet cited in PubMed.

0numbers the graph read from it
0cells of the map it votes in
0citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

0 citing papers in PubMed.

No citing paper in PubMed yet.

4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

13 authors.

Thomas McandrewDepartment of Biostatistics and Health Data Science, College of Health, Lehigh University, Bethlehem, PA, USA. mcandrew@lehigh.edu.
Maimuna S MajumderBoston Children's Hospital, Boston, MA, USA.
Andrew A LoverDepartment of Biostatistics and Epidemiology, School of Public Health and Health Sciences, University of Massachusetts Amherst, Amherst, MA, USA.
Srini VenkatramananBiocomplexity Institute and Initiative, University of Virginia, Charlottesville, VA, USA.
Paolo BocchiniDepartment of Civil and Environmental Engineering, P.C. Rossin College of Engineering and Applied Science, Lehigh University, Bethlehem, PA, USA.
Tamay BesirogluMIT Computer Science and Artificial Intelligence Laboratory, Cambridge, MA, USA.
Allison CodiDepartment of Biostatistics, Rollins School of Public Health, Emory University, Atlanta, GA, USA.
Gaia DempseyMetaculus, Santa Cruz, CA, USA.
Sam AbbottCentre for Mathematical Modelling of Infectious Diseases, London School of Hygiene & Tropical Medicine, Keppel St, London, WC1E 7HT, UK.
Sylvain ChevalierMetaculus, Santa Cruz, CA, USA.
Nikos I BosseMetaculus, Santa Cruz, CA, USA.
Juan CambeiroMetaculus, Santa Cruz, CA, USA.
David BraunDepartment of Psychology, Lehigh University, Bethlehem, PA, USA.

Funding

Digital data streams and machine learning for real-time modeling of vaccine-preventable infectious diseasesR35GM146974 · NIGMS · BOSTON CHILDREN'S HOSPITAL · PI Maimuna Shahnaz Majumder · 2022 to 2026
$2.2M
NIGMS NIH HHS R35 GM146974
6 · The paper itself

Abstract

backgroundIn May 2022, mpox (formerly monkeypox) spread to non-endemic countries rapidly. Human judgment is a forecasting approach that has been sparsely evaluated during the beginning of an outbreak.

methodsWe collected-between May 19, 2022 and July 31, 2022-1275 forecasts from 442 individuals of six questions about the mpox outbreak where ground truth data are now available. Individual human judgment forecasts and an equally weighted ensemble were evaluated, as well as compared to a random walk, autoregressive, and doubling time model.

resultsWe found (1) individual human judgment forecasts underestimated outbreak size, (2) the ensemble forecast median moved closer to the ground truth over time but uncertainty around the median did not appreciably decrease, and (3) compared to computational models, for 2-8 week ahead forecasts, the human judgment ensemble outperformed all three models when using median absolute error and weighted interval score; for one week ahead forecasts a random walk outperformed human judgment.

conclusionsWe propose two possible explanations: at the time a forecast was submitted, the mode was correlated with the most recent (and smaller) observation that would eventually determine ground truth. Several forecasts were solicited on a logarithmic scale which may have caused humans to generate forecasts with unintended, large uncertainty intervals. To aide in outbreak preparedness, platforms that solicit human judgment forecasts may wish to assess whether specifying a forecast on logarithmic scale matches an individual's intended forecast, support human judgment by finding cues that are typically used to build forecasts, and, to improve performance, tailor their platform to allow forecasters to assign zero probability to events.

Indexed as

Disease OutbreaksJudgmentMpox, MonkeypoxForecastingHumansPandemic PreparednessForecastingHuman judgmentMpox

Identifiers

PMID42277702
PMCPMC13483672

What OpenQuestion holds

Textmetadata
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.