Evidence map›Paper›PMID 37578975›Full record

ArticlePLoS computational biology2023

A structured evaluation of genome-scale constraint-based modeling tools for microbial consortia.

William T Scott, Sara Benito-Vaquerizo, Johannes Zimmermann, Djordje Bajić, Almut Heinken, Maria Suarez-Diez, Peter J Schaap

Abstract read
In one paragraph

Article in PLoS computational biology, 2023. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 29 papers.

0numbers the graph read from it
0cells of the map it votes in
29citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

29 citing papers in PubMed.

  1. Review
  2. Article
  3. Review
  4. Article
  5. Article
  6. Article
  7. Dynamic Simulation of Growth and Cross-Feeding in Microbiomes with μbialSim.Methods in molecular biology (Clifton, N.J.) · 2026
    Article
  8. Article
  9. Article
  10. Review
  11. Review
  12. Article
  13. Article
  14. Article
  15. Deciphering and designing microbial communities by genome-scale metabolic modelling.Computational and structural biotechnology journal · 2024
    Review
  16. Article
  17. Article
  18. Article
  19. Article
  20. Review
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

7 authors.

William T ScottLaboratory of Systems and Synthetic Biology, Wageningen University & Research, Wageningen, the Netherlands.ORCID 0000-0002-4029-2998
Sara Benito-VaquerizoLaboratory of Systems and Synthetic Biology, Wageningen University & Research, Wageningen, the Netherlands.ORCID 0000-0003-3936-9676
Johannes ZimmermannChristian-Albrechts-University Kiel, Institute of Experimental Medicine, Research Group Medical Systems Biology, Kiel, Germany.ORCID 0000-0002-5041-1954
Djordje BajićDepartment of Biotechnology, Delft University of Technology, Delft, the Netherlands.
Almut HeinkenInserm U1256 Laboratoire nGERE, Université de Lorraine, Nancy, France.ORCID 0000-0001-6938-8072
Maria Suarez-DiezLaboratory of Systems and Synthetic Biology, Wageningen University & Research, Wageningen, the Netherlands.ORCID 0000-0001-5845-146X
Peter J SchaapLaboratory of Systems and Synthetic Biology, Wageningen University & Research, Wageningen, the Netherlands.ORCID 0000-0002-4346-6084

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

Harnessing the power of microbial consortia is integral to a diverse range of sectors, from healthcare to biotechnology to environmental remediation. To fully realize this potential, it is critical to understand the mechanisms behind the interactions that structure microbial consortia and determine their functions. Constraint-based reconstruction and analysis (COBRA) approaches, employing genome-scale metabolic models (GEMs), have emerged as the state-of-the-art tool to simulate the behavior of microbial communities from their constituent genomes. In the last decade, many tools have been developed that use COBRA approaches to simulate multi-species consortia, under either steady-state, dynamic, or spatiotemporally varying scenarios. Yet, these tools have not been systematically evaluated regarding their software quality, most suitable application, and predictive power. Hence, it is uncertain which tools users should apply to their system and what are the most urgent directions that developers should take in the future to improve existing capacities. This study conducted a systematic evaluation of COBRA-based tools for microbial communities using datasets from two-member communities as test cases. First, we performed a qualitative assessment in which we evaluated 24 published tools based on a list of FAIR (Findability, Accessibility, Interoperability, and Reusability) features essential for software quality. Next, we quantitatively tested the predictions in a subset of 14 of these tools against experimental data from three different case studies: a) syngas fermentation by C. autoethanogenum and C. kluyveri for the static tools, b) glucose/xylose fermentation with engineered E. coli and S. cerevisiae for the dynamic tools, and c) a Petri dish of E. coli and S. enterica for tools incorporating spatiotemporal variation. Our results show varying performance levels of the best qualitatively assessed tools when examining the different categories of tools. The differences in the mathematical formulation of the approaches and their relation to the results were also discussed. Ultimately, we provide recommendations for refining future GEM microbial modeling tools.

Indexed as

Escherichia coliMicrobial ConsortiaGenomeSaccharomyces cerevisiaeSoftware

Identifiers

PMID37578975
PMCPMC10449394

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.