Evidence map›Paper›PMID 39794695›Full record

ArticleBMC genomics2025

BenchAMRking: a Galaxy-based platform for illustrating the major issues associated with current antimicrobial resistance (AMR) gene prediction workflows.

Nikolaos Strepis, Dennis Dollee, Donny Vrins, Kevin Vanneste, Bert Bogaerts, Catherine Carrillo, Amrita Bharat, Kristy Horan, Norelle L Sherry, Torsten Seemann and 5 more

Abstract read
In one paragraph

Article in BMC genomics, 2025. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 2 papers.

0numbers the graph read from it
0cells of the map it votes in
2citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

2 citing papers in PubMed.

  1. Review
  2. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

15 authors.

Nikolaos Strepis *Department of Medical Microbiology and Infectious Diseases, Erasmus University Medical Centre (Erasmus MC), Rotterdam, The Netherlands.ORCID http://orcid.org/0000-0002-0997-8430
Dennis Dollee *Department of Pathology and Clinical Bioinformatics, Erasmus University Medical Centre (Erasmus MC), Rotterdam, The Netherlands.ORCID http://orcid.org/0009-0002-3820-7413
Donny VrinsDepartment of Pathology and Clinical Bioinformatics, Erasmus University Medical Centre (Erasmus MC), Rotterdam, The Netherlands.ORCID http://orcid.org/0009-0009-2054-8595
Kevin VannesteTransversal activities in Applied Genomics, Sciensano, Brussels, Belgium.ORCID http://orcid.org/0009-0000-4051-0628
Bert BogaertsTransversal activities in Applied Genomics, Sciensano, Brussels, Belgium.ORCID http://orcid.org/0000-0003-2806-4033
Catherine CarrilloCanadian Food Inspection Agency, Ottawa, ON, K1A 0Y9, Canada.ORCID http://orcid.org/0000-0002-2334-8718
Amrita BharatNational Microbiology Laboratory, Public Health Agency of Canada, Winnipeg, MB, R3E 3R2, Canada.ORCID http://orcid.org/0000-0003-4171-9436
Kristy HoranMicrobiological Diagnostic Unit Public Health Laboratory (MDU-PHL), Department of Microbiology & Immunology, University of Melbourne at the Peter Doherty Institute for Infection & Immunity, Melbourne, VIC, Australia.ORCID http://orcid.org/0000-0003-3960-1519
Norelle L SherryMicrobiological Diagnostic Unit Public Health Laboratory (MDU-PHL), Department of Microbiology & Immunology, University of Melbourne at the Peter Doherty Institute for Infection & Immunity, Melbourne, VIC, Australia.ORCID http://orcid.org/0000-0002-7789-8360
Torsten SeemannMicrobiological Diagnostic Unit Public Health Laboratory (MDU-PHL), Department of Microbiology & Immunology, University of Melbourne at the Peter Doherty Institute for Infection & Immunity, Melbourne, VIC, Australia.ORCID http://orcid.org/0000-0001-6046-610X
Benjamin P HowdenMicrobiological Diagnostic Unit Public Health Laboratory (MDU-PHL), Department of Microbiology & Immunology, University of Melbourne at the Peter Doherty Institute for Infection & Immunity, Melbourne, VIC, Australia.ORCID http://orcid.org/0000-0003-0237-1473
Saskia HiltemannInstitute of Pharmaceutical Sciences, Faculty of Chemistry and Pharmacy, University of Freiburg, 79104, Freiburg, Germany.ORCID http://orcid.org/0000-0003-3803-468X
Leonid ChindelevitchMRC Centre for Global Infectious Disease Analysis, Imperial College London, London, England, UK. l.chindelevitch@imperial.ac.uk.ORCID http://orcid.org/0000-0002-6619-6013
Andrew P Stubbs *Department of Medical Microbiology and Infectious Diseases, Erasmus University Medical Centre (Erasmus MC), Rotterdam, The Netherlands.ORCID http://orcid.org/0000-0001-9817-9982
John P Hays *Department of Medical Microbiology and Infectious Diseases, Erasmus University Medical Centre (Erasmus MC), Rotterdam, The Netherlands. j.hays@erasmusmc.nl.ORCID http://orcid.org/0000-0001-9183-4497

Funding

Medical Research Council MR/X036936/1ZonMw 549010001
6 · The paper itself

Abstract

backgroundThe Joint Programming Initiative on Antimicrobial Resistance (JPIAMR) networks 'Seq4AMR' and 'B2B2B AMR Dx' were established to promote collaboration between microbial whole genome sequencing (WGS) and antimicrobial resistance (AMR) stakeholders. A key topic discussed was the frequent variability in results obtained between different microbial WGS-related AMR gene prediction workflows. Further, comparative benchmarking studies are difficult to perform due to differences in AMR gene prediction accuracy and a lack of agreement in the naming of AMR genes (semantic conformity) for the results obtained. To illustrate this problem, and as a capacity-building exercise to encourage stakeholder involvement, a comparative Galaxy-based BenchAMRking platform was developed and validated using datasets from bacterial species with PCR-verified AMR gene presence or absence information from abritAMR.

resultsThe Galaxy-based BenchAMRking platform ( https://erasmusmc-bioinformatics.github.io/benchAMRking/ ) specifically focusses on the steps involved in identifying AMR genes from raw reads and sequence assemblies. The platform currently comprises four well-characterised and published workflows that have previously been used to identify AMR genes using WGS data from several different bacterial species. These four workflows, which include the ISO certified abritAMR workflow, make use of different computational tools (or tool versions), and interrogate different AMR gene sequence databases. By utilising their own data, users can investigate potential AMR gene-calling problems associated with their own in silico workflows/protocols, with a potential use case outlined in this publication.

conclusionsBenchAMRking is a Galaxy-based comparison platform where users can access, visualise, and explore some of the major discrepancies associated with AMR gene prediction from microbial WGS data.

Indexed as

BacteriaComputational BiologyDrug Resistance, BacterialGenes, BacterialSoftwareAnti-Bacterial AgentsWhole Genome SequencingWorkflowAnti-Bacterial AgentsAntimicrobial resistanceBenchmarkingGalaxyMicrobial whole genome sequencingWorkflows

Identifiers

PMID39794695
PMCPMC11724594

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.