Evidence map›Paper›PMID 33468057›Full record

Observational studyBMC genomics2021

Reliability of genomic variants across different next-generation sequencing platforms and bioinformatic processing pipelines.

Stephan Weißbach, Stanislav Sys, Charlotte Hewel, Hristo Todorov, Susann Schweiger, Jennifer Winter, Markus Pfenninger, Ali Torkamani, Doug Evans, Joachim Burger and 3 more

Abstract readObservational Study
In one paragraph

Observational study in BMC genomics, 2021. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 8 papers.

0numbers the graph read from it
0cells of the map it votes in
8citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

8 citing papers in PubMed.

  1. Article
  2. Review
  3. Detection of mutations: from Ames test to duplex sequencing.Frontiers in molecular biosciences · 2026
    Review
  4. Article
  5. Article
  6. Review
  7. Article
  8. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

13 authors.

Stephan Weißbach *Institute of Human Genetics, University Medical Center of the Johannes Gutenberg-University Mainz, Mainz, Germany.
Stanislav Sys *Institute of Human Genetics, University Medical Center of the Johannes Gutenberg-University Mainz, Mainz, Germany.
Charlotte Hewel *Institute of Human Genetics, University Medical Center of the Johannes Gutenberg-University Mainz, Mainz, Germany.
Hristo TodorovInstitute of Human Genetics, University Medical Center of the Johannes Gutenberg-University Mainz, Mainz, Germany.
Susann SchweigerInstitute of Human Genetics, University Medical Center of the Johannes Gutenberg-University Mainz, Mainz, Germany.
Jennifer WinterInstitute of Human Genetics, University Medical Center of the Johannes Gutenberg-University Mainz, Mainz, Germany.
Markus PfenningerDepartment of Molecular Ecology, Senckenberg Biodiversity and Climate Research Centre, Senckenberganlage 25, 60325, Frankfurt am Main, Germany.
Ali TorkamaniDepartment of Integrative Structural and Computational Biology, Scripps Research Translational Institute, California Campus, San Diego, USA.
Doug EvansDepartment of Integrative Structural and Computational Biology, Scripps Research Translational Institute, California Campus, San Diego, USA.
Joachim BurgerInstitute of Anthropology, Johannes Gutenberg-University Mainz, Mainz, Germany.
Karin Everschor-SitteInstitute of Physics, Johannes Gutenberg-University Mainz, Mainz, Germany.
Helen Louise May-SimeraInstitute of Molecular Physiology, Johannes Gutenberg-University Mainz, Mainz, Germany.
Susanne GerberInstitute of Human Genetics, University Medical Center of the Johannes Gutenberg-University Mainz, Mainz, Germany. sugerber@uni-mainz.de.ORCID http://orcid.org/0000-0001-9513-0729

Funding

Genotype First: Actionable Genetic Risk through Genotype-to-Phenotype PredictionR01HG010881 · NHGRI · SCRIPPS RESEARCH INSTITUTE, THE · PI TORKAMANI, ALI · 2020 to 2023
$3.1M
Scripps Genome ADVISER: Annotation and Distributed Variant Interpretation SERverU01HG006476 · NHGRI · SCRIPPS HEALTH · PI TORKAMANI, ALI · 2012 to 2015
$1.1M
Carl-Zeiss-Stiftung Emergent AI CenterM3odel Mainz Institute of Multiscale ModelingNHGRI NIH HHS R01 HG010881NHGRI NIH HHS U01 HG006476ReALity Resilience, Adaptation and Longevity
6 · The paper itself

Abstract

backgroundNext Generation Sequencing (NGS) is the fundament of various studies, providing insights into questions from biology and medicine. Nevertheless, integrating data from different experimental backgrounds can introduce strong biases. In order to methodically investigate the magnitude of systematic errors in single nucleotide variant calls, we performed a cross-sectional observational study on a genomic cohort of 99 subjects each sequenced via (i) Illumina HiSeq X, (ii) Illumina HiSeq, and (iii) Complete Genomics and processed with the respective bioinformatic pipeline. We also repeated variant calling for the Illumina cohorts with GATK, which allowed us to investigate the effect of the bioinformatics analysis strategy separately from the sequencing platform's impact.

resultsThe number of detected variants/variant classes per individual was highly dependent on the experimental setup. We observed a statistically significant overrepresentation of variants uniquely called by a single setup, indicating potential systematic biases. Insertion/deletion polymorphisms (indels) were associated with decreased concordance compared to single nucleotide polymorphisms (SNPs). The discrepancies in indel absolute numbers were particularly prominent in introns, Alu elements, simple repeats, and regions with medium GC content. Notably, reprocessing sequencing data following the best practice recommendations of GATK considerably improved concordance between the respective setups.

conclusionWe provide empirical evidence of systematic heterogeneity in variant calls between alternative experimental and data analysis setups. Furthermore, our results demonstrate the benefit of reprocessing genomic data with harmonized pipelines when integrating data from different studies.

Indexed as

Computational BiologyHigh-Throughput Nucleotide SequencingCross-Sectional StudiesGenomicsHumansPolymorphism, Single NucleotideReproducibility of ResultsAgingComplete genomicsGATKHealthy agingIlluminaLongevityNext-generation sequencing (NGS) technologiesPlatform-biasesWellderly

Identifiers

PMID33468057
PMCPMC7814447

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.