Evidence map›Paper›PMID 33632222›Full record

ArticleMalaria journal2021

Performance of a fully-automated system on a WHO malaria microscopy evaluation slide set.

Matthew P Horning, Charles B Delahunt, Christine M Bachman, Jennifer Luchavez, Christian Luna, Liming Hu, Mayoore S Jaiswal, Clay M Thompson, Sourabh Kulhare, Samantha Janko and 19 more

Open access · goldAbstract read
In one paragraph

Article in Malaria journal, 2021. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 33 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
33citing papers in PubMed, 1 pooled it
6.0field-weighted citation impact, top 3% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

33 citing papers in PubMed, 1 synthesis or guideline pooled it, 67 citations in OpenAlex.

  1. Pooled it
  2. Article
  3. Article
  4. Review
  5. Review
  6. Article
  7. Article
  8. Review
  9. Article
  10. Article
  11. Article
  12. Article
  13. Article
  14. Article
  15. Article
  16. Article
  17. Article
  18. Review
  19. Article
  20. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

29 authors at 15 institutions in 9 countries.

Matthew P HorningGlobal Health Labs (formerly at Intellectual Ventures Laboratory/Global Good), 14360 SE Eastgate Way, Bellevue, WA, 98007, USA. matthew.horning@ghlabs.org.ORCID http://orcid.org/0000-0002-1736-7090
Charles B DelahuntGlobal Health Labs (formerly at Intellectual Ventures Laboratory/Global Good), 14360 SE Eastgate Way, Bellevue, WA, 98007, USA.
Christine M BachmanGlobal Health Labs (formerly at Intellectual Ventures Laboratory/Global Good), 14360 SE Eastgate Way, Bellevue, WA, 98007, USA.
Jennifer LuchavezResearch Institute for Tropical Medicine, Muntinlupa, Philippines.
Christian LunaResearch Institute for Tropical Medicine, Muntinlupa, Philippines.
Liming HuGlobal Health Labs (formerly at Intellectual Ventures Laboratory/Global Good), 14360 SE Eastgate Way, Bellevue, WA, 98007, USA.
Mayoore S Jaiswalformerly Intellectual Ventures Laboratory, 3150 139th AVE SE, Bellevue, WA, 98005, USA.
Clay M ThompsonCreative Creek LLC, Camano Island, WA, USA.
Sourabh KulhareGlobal Health Labs (formerly at Intellectual Ventures Laboratory/Global Good), 14360 SE Eastgate Way, Bellevue, WA, 98007, USA.
Samantha JankoArizona State University, Tempe, AZ, USA.
Benjamin K WilsonGlobal Health Labs (formerly at Intellectual Ventures Laboratory/Global Good), 14360 SE Eastgate Way, Bellevue, WA, 98007, USA.
Travis OstbyeGlobal Health Labs (formerly at Intellectual Ventures Laboratory/Global Good), 14360 SE Eastgate Way, Bellevue, WA, 98007, USA.
Martha MehanianGlobal Health Labs (formerly at Intellectual Ventures Laboratory/Global Good), 14360 SE Eastgate Way, Bellevue, WA, 98007, USA.
Roman Gebrehiwotformerly Intellectual Ventures Laboratory, 3150 139th AVE SE, Bellevue, WA, 98005, USA.
Grace Yunformerly Intellectual Ventures Laboratory, 3150 139th AVE SE, Bellevue, WA, 98005, USA.
David BellIndependent Consultant, Issaquah, WA, USA.
Stephane ProuxShoklo Malaria Research Unit, Mahidol Oxford Tropical Medicine Research Unit, Faculty of Tropical Medicine, Mahidol University, Mae Sot, Thailand.
Jane Y CarterAmref Health Africa, Nairobi, Kenya.
Wellington OyiboUniversity of Lagos, Lagos, Nigeria.
Dionicia GamboaLaboratorios de Investigacion y Desarrollo, Facultad de Ciencias y Filosofia, Universidad Peruana Cayetano Heredia, Lima, Peru.
Mehul DhordaWorld Wide Antimalarial Resistance Network and Mahidol-Oxford Tropical Medicine Research Unit, Bangkok, Thailand.
Ranitha VongpromekInfectious Diseases Data Observatory and World Wide Antimalarial Resistance Network, Asia- Pacific Regional Centre, Bangkok, Thailand.
Peter L ChiodiniHospital for Tropical Diseases and the London School of Hygiene and Tropical Medicine, London, UK.
Bernhards OgutuKenya Medical Research Institute, Nairobi, Kenya.
Earl G LongCenters for Disease Control and Prevention, Atlanta, GA, USA.
Kyaw TunDefence Services Medical Academy, Mingaladon, Myanmar.
Thomas R BurkotAustralian Institute of Tropical Health and Medicine, James Cook University, Cairns, Australia.
Ken LilleyAustralian Defence Force Malaria and Infectious Disease Institute, Enoggera, Australia.
Courosh MehanianGlobal Health Labs (formerly at Intellectual Ventures Laboratory/Global Good), 14360 SE Eastgate Way, Bellevue, WA, 98007, USA.
Intellectual Ventures (United States) · USBellevue Hospital Center · USResearch Institute for Tropical Medicine · PHAmref Health Africa · KEArizona State University · USAustralian Institute of Tropical Health and Medicine · AUCenters for Disease Control and Prevention · USKenya Medical Research Institute · KELondon School of Hygiene & Tropical Medicine · GBMahidol Oxford Tropical Medicine Research Unit · THMahidol University · THMyanmar Oxford Clinical Research Unit · MMUniversidad Peruana Cayetano Heredia · PEUniversity of Lagos · NGUniversity of Washington · US

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

backgroundManual microscopy remains a widely-used tool for malaria diagnosis and clinical studies, but it has inconsistent quality in the field due to variability in training and field practices. Automated diagnostic systems based on machine learning hold promise to improve quality and reproducibility of field microscopy. The World Health Organization (WHO) has designed a 55-slide set (WHO 55) for their External Competence Assessment of Malaria Microscopists (ECAMM) programme, which can also serve as a valuable benchmark for automated systems. The performance of a fully-automated malaria diagnostic system, EasyScan GO, on a WHO 55 slide set was evaluated.

methodsThe WHO 55 slide set is designed to evaluate microscopist competence in three areas of malaria diagnosis using Giemsa-stained blood films, focused on crucial field needs: malaria parasite detection, malaria parasite species identification (ID), and malaria parasite quantitation. The EasyScan GO is a fully-automated system that combines scanning of Giemsa-stained blood films with assessment algorithms to deliver malaria diagnoses. This system was tested on a WHO 55 slide set.

resultsThe EasyScan GO achieved 94.3 % detection accuracy, 82.9 % species ID accuracy, and 50 % quantitation accuracy, corresponding to WHO microscopy competence Levels 1, 2, and 1, respectively. This is, to our knowledge, the best performance of a fully-automated system on a WHO 55 set.

conclusionsEasyScan GO's expert ratings in detection and quantitation on the WHO 55 slide set point towards its potential value in drug efficacy use-cases, as well as in some case management situations with less stringent species ID needs. Improved runtime may enable use in general case management settings.

Indexed as

Automation, LaboratoryDiagnostic Tests, RoutineHumansMalariaMalaria, FalciparumMicroscopyPlasmodiumPlasmodium falciparumReproducibility of ResultsWorld Health OrganizationAutomated diagnosisMachine learningMalariaMicroscopyWHO

Identifiers

PMID33632222
PMCPMC7905596
OpenAlexW3131093237

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.