Evidence map›Paper›PMID 25880246›Full record

ArticleBMC microbiology2015

The truth about metagenomics: quantifying and counteracting bias in 16S rRNA studies.

J Paul Brooks, David J Edwards, Michael D Harwich, Maria C Rivera, Jennifer M Fettweis, Myrna G Serrano, Robert A Reris, Nihar U Sheth, Bernice Huang, Philippe Girerd and 4 more

Abstract read
In one paragraph

Article in BMC microbiology, 2015. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 265 papers, 3 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
265citing papers in PubMed, 3 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

265 citing papers in PubMed, 3 syntheses or guidelines pooled it.

  1. Pooled it
  2. Pooled it
  3. Pooled it
  4. Microbiology spectrum · 2025
    Trial
  5. Trial
  6. Article
  7. Article
  8. Article
  9. Article
  10. Article
  11. Article
  12. Article
  13. Article
  14. Article
  15. Article
  16. Article
  17. Article
  18. Review
  19. Article
  20. Article

205 more citing papers are in PubMed but not listed here.

4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

14 authors.

J Paul BrooksDepartment of Statistical Sciences and Operations Research, Virginia Commonwealth University, 23284-3083, Richmond, VA, USA. jpbrooks@vcu.edu.
David J EdwardsDepartment of Statistical Sciences and Operations Research, Virginia Commonwealth University, 23284-3083, Richmond, VA, USA. dedwards7@vcu.edu.
Michael D HarwichDepartment of Microbiology and Immunology, Virginia Commonwealth University, 23284, Richmond, VA, USA. harwichmd@gmail.com.
Maria C RiveraDepartment of Biology, Virginia Commonwealth University, 23284, Richmond, VA, USA. mcrivera@vcu.edu.
Jennifer M FettweisDepartment of Microbiology and Immunology, Virginia Commonwealth University, 23284, Richmond, VA, USA. fettweisjm@vcu.edu.
Myrna G SerranoCenter for the Study of Biological Complexity, Virginia Commonwealth University, 23284, Richmond, VA, USA. mgserrano@vcu.edu.
Robert A RerisDepartment of Statistical Sciences and Operations Research, Virginia Commonwealth University, 23284-3083, Richmond, VA, USA. rerisra@vcu.edu.
Nihar U ShethCenter for the Study of Biological Complexity, Virginia Commonwealth University, 23284, Richmond, VA, USA. nsheth@vcu.edu.
Bernice HuangDepartment of Microbiology and Immunology, Virginia Commonwealth University, 23284, Richmond, VA, USA. huangb2@vcu.edu.
Philippe GirerdDepartment of Obstetrics and Gynecology, Virginia Commonwealth University, 23284, Richmond, VA, USA. pgirerd@vcu.edu.
Vaginal Microbiome Consortium
Jerome F StraussDepartment of Obstetrics and Gynecology, Virginia Commonwealth University, 23284, Richmond, VA, USA. jfstrauss@vcu.edu.
Kimberly K JeffersonCenter for the Study of Biological Complexity, Virginia Commonwealth University, 23284, Richmond, VA, USA. kkjefferson@vcu.edu.
Gregory A BuckCenter for the Study of Biological Complexity, Virginia Commonwealth University, 23284, Richmond, VA, USA. gabuck@vcu.edu.

Funding

VCU NIMHD Comprehensive Center of Excellence (Project 1; PI: Strauss)P60MD002256 · NIMHD · VIRGINIA COMMONWEALTH UNIVERSITY · PI BRADLEY, CATHY J · 2007 to 2016
$13.1M
A Multi-'omic Analysis of the Vaginal Microbiome during PregnancyU54HD080784 · NICHD · VIRGINIA COMMONWEALTH UNIVERSITY · PI BUCK, GREGORY ALLEN, JEFFERSON, KIMBERLY KAY · 2014 to 2015
$8.2M
CHARACTERIZATION OF CATFISH CYTOTOXIC T LYMPHOCYTESF32AI008326 · NIAID · UNIVERSITY OF MISSISSIPPI MEDICAL CENTER · PI YOSHIDA, STEVEN H · 1990 to 1991
–
NIAID NIH HHS UH3AI08326-01NICHD NIH HHS 8U54HD080784NICHD NIH HHS U54 HD080784NIMHD NIH HHS 2P60MD002256-06NIMHD NIH HHS P60 MD002256
6 · The paper itself

Abstract

backgroundCharacterizing microbial communities via next-generation sequencing is subject to a number of pitfalls involving sample processing. The observed community composition can be a severe distortion of the quantities of bacteria actually present in the microbiome, hampering analysis and threatening the validity of conclusions from metagenomic studies. We introduce an experimental protocol using mock communities for quantifying and characterizing bias introduced in the sample processing pipeline. We used 80 bacterial mock communities comprised of prescribed proportions of cells from seven vaginally-relevant bacterial strains to assess the bias introduced in the sample processing pipeline. We created two additional sets of 80 mock communities by mixing prescribed quantities of DNA and PCR product to quantify the relative contribution to bias of (1) DNA extraction, (2) PCR amplification, and (3) sequencing and taxonomic classification for particular choices of protocols for each step. We developed models to predict the "true" composition of environmental samples based on the observed proportions, and applied them to a set of clinical vaginal samples from a single subject during four visits.

resultsWe observed that using different DNA extraction kits can produce dramatically different results but bias is introduced regardless of the choice of kit. We observed error rates from bias of over 85% in some samples, while technical variation was very low at less than 5% for most bacteria. The effects of DNA extraction and PCR amplification for our protocols were much larger than those due to sequencing and classification. The processing steps affected different bacteria in different ways, resulting in amplified and suppressed observed proportions of a community. When predictive models were applied to clinical samples from a subject, the predicted microbiome profiles were better reflections of the physiology and diagnosis of the subject at the visits than the observed community compositions.

conclusionsBias in 16S studies due to DNA extraction and PCR amplification will continue to require attention despite further advances in sequencing technology. Analysis of mock communities can help assess bias and facilitate the interpretation of results from environmental samples.

Indexed as

ArtifactsGenes, rRNABacteriaBiasDNA, BacterialFemaleHigh-Throughput Nucleotide SequencingHumansMetagenomicsMicrobial ConsortiaMicrobiotaModels, BiologicalPhylogenyPolymerase Chain ReactionRNA, Ribosomal, 16SSpecimen HandlingDNA, BacterialRNA, Ribosomal, 16S

Identifiers

PMID25880246
PMCPMC4433096

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.