Group-wise normalization in differential abundance analysis of microbiome samples.

Motivation: A key challenge in differential abundance analysis of microbial samples is that the counts for each sample are compositional, resulting in biased comparisons of the absolute abundance across study groups. Normalization-based differential abundance analysis methods rely on external normalization factors that account for the compositionality by standardizing the counts onto a common numerical scale. However, existing normalization methods have struggled at maintaining the false discovery rate in settings where the variance or compositional bias is large. This article proposes a novel framework for normalization that can reduce bias in differential abundance analysis by re-conceptualizing normalization as a group-level task. We present two normalization methods within the group-wise framework: group-wise relative log expression (G-RLE) and fold-truncated sum scaling (FTSS). Results: G-RLE and FTSS achieve higher statistical power for identifying differentially abundant taxa than existing methods in model-based and synthetic data simulation settings, while maintaining the false discovery rate in challenging scenarios where existing methods suffer. The best results are obtained from using FTSS normalization with the differential abundance analysis method MetagenomeSeq. Availability and Implementation: Code for implementing the methods and replicating the analysis can be found at our GitHub page.