Evidence map›Paper›PMID 38299829›Full record

ArticleJournal of clinical microbiology2024

Retrospective validation of MetaSystems' deep-learning-based digital microscopy platform with assistance compared to manual fluorescence microscopy for detection of mycobacteria.

Claudine Desruisseaux, Conor Broderick, Valéry Lavergne, Kim Sy, Duang-Jai Garcia, Gaurav Barot, Kerstin Locher, Charlene Porter, Mélissa Caza, Marthe K Charles

Open access · hybridAbstract read
In one paragraph

Article in Journal of clinical microbiology, 2024. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 4 papers.

0numbers the graph read from it
0cells of the map it votes in
4citing papers in PubMed
3.9field-weighted citation impact, top 6% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

4 citing papers in PubMed, 10 citations in OpenAlex.

  1. Review
  2. Article
  3. Review
  4. Review
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

10 authors at 2 institutions in 1 country.

Claudine DesruisseauxDivision of Medical Microbiology and Infection Control, Department of Pathology and Laboratory Medicine, Vancouver General Hospital, Vancouver Coastal Health, Vancouver, British Columbia, Canada.
Conor BroderickFaculty of Medicine, Department of Pathology and Laboratory Medicine, The University of British Columbia, Vancouver, British Columbia, Canada.
Valéry LavergneDivision of Medical Microbiology and Infection Control, Department of Pathology and Laboratory Medicine, Vancouver General Hospital, Vancouver Coastal Health, Vancouver, British Columbia, Canada.
Kim SyDivision of Medical Microbiology and Infection Control, Department of Pathology and Laboratory Medicine, Vancouver General Hospital, Vancouver Coastal Health, Vancouver, British Columbia, Canada.
Duang-Jai GarciaDivision of Medical Microbiology and Infection Control, Department of Pathology and Laboratory Medicine, Vancouver General Hospital, Vancouver Coastal Health, Vancouver, British Columbia, Canada.
Gaurav BarotDivision of Medical Microbiology and Infection Control, Department of Pathology and Laboratory Medicine, Vancouver General Hospital, Vancouver Coastal Health, Vancouver, British Columbia, Canada.
Kerstin LocherDivision of Medical Microbiology and Infection Control, Department of Pathology and Laboratory Medicine, Vancouver General Hospital, Vancouver Coastal Health, Vancouver, British Columbia, Canada.ORCID 0000-0002-0175-3747
Charlene PorterDivision of Medical Microbiology and Infection Control, Department of Pathology and Laboratory Medicine, Vancouver General Hospital, Vancouver Coastal Health, Vancouver, British Columbia, Canada.
Mélissa CazaFaculty of Medicine, Department of Pathology and Laboratory Medicine, The University of British Columbia, Vancouver, British Columbia, Canada.
Marthe K CharlesDivision of Medical Microbiology and Infection Control, Department of Pathology and Laboratory Medicine, Vancouver General Hospital, Vancouver Coastal Health, Vancouver, British Columbia, Canada.ORCID 0000-0002-3663-0974
Vancouver Coastal Health · CAUniversity of British Columbia · CA

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

This study aimed to validate Metasystems' automated acid-fast bacilli (AFB) smear microscopy scanning and deep-learning-based image analysis module (Neon Metafer) with assistance on respiratory and pleural samples, compared to conventional manual fluorescence microscopy (MM). Analytical parameters were assessed first, followed by a retrospective validation study. In all, 320 archived auramine-O-stained slides selected non-consecutively [85 originally reported as AFB-smear-positive, 235 AFB-smear-negative slides; with an overall mycobacterial culture positivity rate of 24.1% (77/320)] underwent whole-slide imaging and were analyzed by the Metafer Neon AFB Module (version 4.3.130) using a predetermined probability threshold (PT) for AFB detection of 96%. Digital slides were then examined by a trained reviewer blinded to previous AFB smear and culture results, for the final interpretation of assisted digital microscopy (a-DM). Paired results from both microscopic methods were compared to mycobacterial culture. A scanning failure rate of 10.6% (34/320) was observed, leaving 286 slides for analysis. After discrepant analysis, concordance, positive and negative agreements were 95.5% (95%CI, 92.4%-97.6%), 96.2% (95%CI, 89.2%-99.2%), and 95.2% (95%CI, 91.3%-97.7%), respectively. Using mycobacterial culture as reference standard, a-DM and MM had comparable sensitivities: 90.7% (95%CI, 81.7%-96.2%) versus 92.0% (95%CI, 83.4%-97.0%) ( IMPORTANCE: This manuscript presents a full validation of MetaSystems' automated acid-fast bacilli (AFB) smear microscopy scanning and deep-learning-based image analysis module using a probability threshold of 96% including accuracy, precision studies, and evaluation of limit of AFB detection on respiratory samples when the technology is used with assistance. This study is complementary to the conversation started by Tomasello et al. on the use of image analysis artificial intelligence software in routine mycobacterial diagnostic activities within the context of high-throughput laboratories with low incidence of tuberculosis.

Indexed as

Deep LearningMycobacteriumMycobacterium tuberculosisTuberculosisArtificial IntelligenceHumansMicroscopy, FluorescenceNeonRetrospective StudiesSputumNeonacid-fast bacilliAFB fluorescence microscopyartificial intelligenceautomated digital microscopyclinical validationdeep learningdeep neural networkmycobacteria

Identifiers

PMID38299829
PMCPMC10935628
OpenAlexW4391434590

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.