Evidence map›Paper›PMID 40331433›Full record

ArticleNucleic acids research2025

CAMI Benchmarking Portal: online evaluation and ranking of metagenomic software.

Fernando Meyer, Gary Robertson, Zhi-Luo Deng, David Koslicki, Alexey Gurevich, Alice C McHardy

Abstract read
In one paragraph

Article in Nucleic acids research, 2025. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 5 papers.

0numbers the graph read from it
0cells of the map it votes in
5citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

5 citing papers in PubMed.

  1. Review
  2. Article
  3. Article
  4. Review
  5. Review
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

6 authors.

Fernando MeyerComputational Biology of Infection Research, Helmholtz Centre for Infection Research (HZI), 38124 Braunschweig, Germany.ORCID 0000-0002-0901-3815
Gary RobertsonComputational Biology of Infection Research, Helmholtz Centre for Infection Research (HZI), 38124 Braunschweig, Germany.
Zhi-Luo DengComputational Biology of Infection Research, Helmholtz Centre for Infection Research (HZI), 38124 Braunschweig, Germany.ORCID 0000-0003-1242-7557
David KoslickiInitiative for the Critical Assessment of Metagenome Interpretation (CAMI ).ORCID 0000-0002-0640-954X
Alexey GurevichInitiative for the Critical Assessment of Metagenome Interpretation (CAMI ).ORCID 0000-0002-5855-3519
Alice C McHardyComputational Biology of Infection Research, Helmholtz Centre for Infection Research (HZI), 38124 Braunschweig, Germany.ORCID 0000-0003-2370-3430

Funding

Leveraging k-mer sketching statistics to enhance metagenomic methods and alignment algorithmsR01GM146462 · NIGMS · PENNSYLVANIA STATE UNIVERSITY, THE · PI Antonio Blanca Pimentel, David Koslicki · 2022 to 2026
$2.2M
Deutsche Forschungsgemeinschaft 460129525NFDI4Microbiota consortiumNIGMS NIH HHS R01 GM146462
6 · The paper itself

Abstract

Finding appropriate software and parameter settings to process shotgun metagenome data is essential for meaningful metagenomic analyses. To enable objective and comprehensive benchmarking of metagenomic software, the community-led initiative for the Critical Assessment of Metagenome Interpretation (CAMI) promotes standards and best practices. Since 2015, CAMI has provided comprehensive datasets, benchmarking guidelines, and challenges. However, benchmarking had to be conducted offline, requiring substantial time and technical expertise and leading to gaps in results between challenges. We introduce the CAMI Benchmarking Portal-a central repository of CAMI resources and web server for the evaluation and ranking of metagenome assembly, binning, and taxonomic profiling software. The portal simplifies evaluation, enabling users to easily compare their results with previous and other users' submissions through a variety of metrics and visualizations. As a demonstration, we benchmark software performance on the marine dataset of the CAMI II challenge. The portal currently hosts 28 675 results and is freely available at https://cami-challenge.org/.

Indexed as

MetagenomeMetagenomicsSoftwareBenchmarkingInternet

Identifiers

PMID40331433
PMCPMC12230735

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.