Evidence map›Paper›PMID 40038598›Full record

ArticleBMC public health2025

Evaluation of the epidemic intelligence from open sources (EIOS) system for the early detection of outbreaks and health emergencies in the African region.

George Sie Williams, Etien Luc Koua, Philip Abdelmalik, Freddy Kambale, Emerencienne Kibangou, Joyce Nguna, Charles Okot, Godwin Akpan, Fleury Moussana, Jean Paul Kimenyi and 6 more

Abstract readEvaluation Study
In one paragraph

Article in BMC public health, 2025. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 11 papers.

0numbers the graph read from it
0cells of the map it votes in
11citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

11 citing papers in PubMed.

  1. Article
  2. Article
  3. Review
  4. Article
  5. Article
  6. Article
  7. Review
  8. Review
  9. Article
  10. Article
  11. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

16 authors.

George Sie WilliamsEmergency Preparedness and Response Cluster, WHO Regional Office for Africa, Brazzaville, Congo.
Etien Luc KouaEmergency Preparedness and Response Cluster, WHO Regional Office for Africa, Brazzaville, Congo.
Philip AbdelmalikWHO Hub for Pandemic and Epidemic Intelligence, Berlin, Germany.
Freddy KambaleWHO Regional Emergency Hub, Dakar, Senegal.
Emerencienne KibangouWHO Regional Emergency Hub, Dakar, Senegal.
Joyce NgunaWHO Regional Emergency Hub, Nairobi, Kenya.
Charles OkotEmergency Preparedness and Response Cluster, WHO Regional Office for Africa, Brazzaville, Congo.
Godwin AkpanEmergency Preparedness and Response Cluster, WHO Regional Office for Africa, Brazzaville, Congo.
Fleury MoussanaEmergency Preparedness and Response Cluster, WHO Regional Office for Africa, Brazzaville, Congo.
Jean Paul KimenyiWHO Regional Emergency Hub, Dakar, Senegal.
Ramazani ZazaWHO Regional Emergency Hub, Nairobi, Kenya.
Raquel Medialdea CarerraWHO Hub for Pandemic and Epidemic Intelligence, Berlin, Germany.
Yasmin RabiyanWHO Hub for Pandemic and Epidemic Intelligence, Berlin, Germany.
Mark WoolhouseTackling Infections to Benefit Africa, University of Edinburgh, Edinburgh, UK.
Joseph OkeibunorEmergency Preparedness and Response Cluster, WHO Regional Office for Africa, Brazzaville, Congo. okeibunorj@who.int.
Abdou Salam GueyeEmergency Preparedness and Response Cluster, WHO Regional Office for Africa, Brazzaville, Congo.

Funding

World Health Organization 001
6 · The paper itself

Abstract

introductionPublic health today is challenged by a wide array of hazards that threaten humans, often resulting in high rates of morbidity and mortality when they strike. These events should be detected and responded to as early as possible to save lives and minimize their impact. The Epidemic Intelligence from Open Sources (EIOS) system leverages natural language processing and machine learning techniques for the early detection of public health events from open-source information using an all-hazards approach. In this study, we quantitatively evaluate the performance of the EIOS system for the early detection of outbreaks and health emergencies in the African region.

methodsWe retrospectively searched the EIOS system to determine if a signal was found on the system for each public health event notified to WHO by the 47 countries in the African region from 2018 to 2023. We computed the proportion of public health event detected by the EIOS system, its sensitivity, harmonic mean, and timeliness. We assessed the association between selected predictors (year of report, hazard type, subregion, source type, and language of source) and early detection of public health events on the EIOS system using a multivariable logistic regression model.

resultsWe found a detection proportion of 81.0% and a sensitivity of 47.4%, with a harmonic mean of 59.8%. The proportion of events detected steadily increased over the years and sensitivity increased from a baseline of 44.1% in 2018 to 47.3% in 2023. Signals for more than 80.0% of the public health events notified to WHO in 28 countries were detected on the EIOS system. In 22 countries, signals of at least 50% of the public health events were detected early, that is, before official notification from the National Authorities to WHO. The median time between detection on the EIOS system and notification to WHO was zero days. We found that the type of hazard (infectious and zoonotic), the subregion (West and Central Africa), and the type of source (medical and social media) were associated with early detection.

conclusionsWe conclude that the EIOS system performed well in detecting public health events in the African region early. However, some improvements are needed. We recommend increasing social media and local community radio sources on the EIOS system.

Indexed as

Disease OutbreaksEmergenciesAfricaEarly DiagnosisEpidemicsHumansMachine LearningNatural Language ProcessingRetrospective Studies

Identifiers

PMID40038598
PMCPMC11877865

What OpenQuestion holds

Textmetadata
LicenceCC BY-NC-ND
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.